Apr 15 00:09:21 devstack cinder-volume[73105]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 00:09:21 devstack cinder-volume[73105]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 00:09:21 devstack cinder-volume[73105]: we strongly recommend against using it for new projects. Apr 15 00:09:21 devstack cinder-volume[73105]: If you are already using Eventlet, we recommend migrating to a different Apr 15 00:09:21 devstack cinder-volume[73105]: framework. For more detail see Apr 15 00:09:21 devstack cinder-volume[73105]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 00:09:21 devstack cinder-volume[73105]: import eventlet # noqa Apr 15 00:09:23 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:09:23 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:09:23 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO dbcounter [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Registered counter for database cinder Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_db.sqlalchemy.engines [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG dbcounter [-] [73105] Writer thread running {{(pid=73105) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.rpc [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.rpc [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_db.sqlalchemy.engines [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.volume.manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Determined volume DB was empty at startup. Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG cinder.volume.manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73105) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.volume.manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING stevedore.named [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING castellan.key_manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING cinder.keymgr.conf_key_mgr [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG cinder.volume.drivers.lvm [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73105) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_concurrency.processutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73105) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_concurrency.processutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] CMD "cinder-rtstool verify" returned: 0 in 0.317s {{(pid=73105) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_db.sqlalchemy.engines [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.rpc [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.rpc [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING stevedore.named [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING castellan.key_manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:09:24 devstack cinder-volume[73105]: INFO cinder.volume.manager [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_db.sqlalchemy.engines [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73105) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:09:24 devstack cinder-volume[73105]: INFO oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Starting 1 workers Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Started child 73213 {{(pid=73105) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Full set of CONF: {{(pid=73105) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] ******************************************************************************** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Configuration options gathered from: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] ================================================================================ {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] allow_availability_zone_fallback = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] allow_compression_on_image_upload = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] allowed_direct_url_schemes = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] api_rate_limit = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] auth_strategy = keystone {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] az_cache_duration = 3600 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_availability_zone = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_host = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_stats_polling_interval = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73213]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backup_api_class = cinder.backup.api.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backup_name_template = backup-%s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backup_use_same_host = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backup_use_temp_snapshot = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] chap_password = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] chap_username = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_internal_tenant_project_id = a570808b1f58478e9fc2a203f840e287 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_internal_tenant_user_id = 59212e5e579749b6baa11af8ac99cf4c {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cloned_volume_same_az = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cluster = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] compression_format = gzip {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] compute_api_class = cinder.compute.nova.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] config_dir = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] config_source = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] control_exchange = openstack {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] debug = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] default_availability_zone = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] default_group_type = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] default_volume_type = lvmdriver-1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] disk_geometry = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_client_cert = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_client_cert_key = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_data_namespace = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_ssl_cert_path = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_ssl_cert_verify = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] driver_use_ssl = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] enable_force_upload = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] enable_new_services = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] enable_unsupported_driver = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] enabled_backends = ['lvmdriver-1'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] enforce_multipath_for_image_xfer = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] filter_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_api_insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_api_servers = ['http://192.168.122.105/image'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_api_ssl_compression = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_ca_certificates_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_catalog_info = image:glance:publicURL {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_num_retries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance_request_timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] goodness_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] graceful_shutdown_timeout = 5 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] group_api_class = cinder.group.api.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] host = devstack {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_compress_on_upload = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_conversion_address_space_limit = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_conversion_cpu_limit = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_conversion_disable = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_upload_use_cinder_backend = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_upload_use_internal_tenant = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_volume_cache_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_volume_cache_max_count = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] image_volume_cache_max_size_gb = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] init_host_max_objects_retrieval = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] instance_format = [instance: %(uuid)s] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iscsi_target_flags = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iscsi_write_cache = on {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iser_helper = tgtadm {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iser_ip_address = 192.168.122.105 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iser_port = 3260 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_color = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_config_append = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_dir = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_options = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_rotate_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_rotate_interval_type = days {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] log_rotation_type = none {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] max_age = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] max_logfile_count = 30 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] max_logfile_size_mb = 200 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] max_over_subscription_ratio = 20.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] message_reap_interval = 86400 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] message_ttl = 2592000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] migration_create_volume_timeout_secs = 300 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] monkey_patch = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] monkey_patch_modules = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] my_ip = 192.168.122.105 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] no_snapshot_gb_quota = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] num_iser_scan_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] num_shell_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] num_volume_device_scan_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] nvmeof_conn_info_version = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] nvmet_ns_id = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] nvmet_port_id = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_max_limit = 1000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_ext_list = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_listen = 0.0.0.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_listen_port = 8776 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_use_ssl = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] osapi_volume_workers = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] per_volume_size_limit = -1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] periodic_fuzzy_delay = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] periodic_interval = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] project_id_regex = [0-9a-f\-]+ {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] public_endpoint = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] publish_errors = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_backup_gigabytes = 1000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_backups = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_gigabytes = 1000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_groups = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_snapshots = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] quota_volumes = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] rate_limit_burst = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] rate_limit_except_level = CRITICAL {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] rate_limit_interval = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] reinit_driver_count = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] replication_device = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] report_discard_supported = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] report_interval = 120 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] reservation_clean_interval = 86400 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] reservation_expire = 86400 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] reserved_image_namespaces = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] reserved_percentage = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] rpc_response_timeout = 120 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] run_external_periodic_tasks = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] scst_target_driver = iscsi {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] scst_target_iqn_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_down_time = 720 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] shell_completion = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] snapshot_name_template = snapshot-%s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] snapshot_same_host = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] split_loggers = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] state_path = /opt/stack/data/cinder {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] storage_availability_zone = nova {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] storage_protocol = iSCSI {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] syslog_log_facility = LOG_USER {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_helper = lioadm {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_ip_address = 192.168.122.105 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_port = 3260 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_protocol = iscsi {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] target_secondary_ip_addresses = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73213]: INFO cinder.volume.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] trace_flags = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] transfer_api_class = cinder.transfer.api.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] transport_url = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] until_refresh = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_chap_auth = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_default_quota_class = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_journal = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_json = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_multipath_for_image_xfer = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_stderr = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] use_syslog = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] verify_glance_signatures = enabled {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_api_class = cinder.volume.api.API {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_backend_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_clear = zero {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_clear_ionice = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_clear_size = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_copy_bps_limit = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_dd_blocksize = 1M {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_name_template = volume-%s {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_service_inithost_offload = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volume_usage_audit_period = month {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] zoning_mode = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_concurrency.disable_process_locking = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.admin_password = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.admin_token = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.admin_user = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_admin_prefix = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_port = 35357 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_protocol = https {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_section = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_type = password {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_uri = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.auth_version = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.cache = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.identity_uri = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.include_service_catalog = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.interface = public {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_password = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcache_username = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.region_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.service_type = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.backend = dogpile.cache.null {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.backend_argument = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.backend_expiration_time = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.config_prefix = cache.oslo {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.debug_cache_backend = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.enable_retry_client = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.enable_socket_keepalive = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.enforce_fips_mode = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.expiration_time = 600 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.hashclient_retry_attempts = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_dead_retry = 300 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_pool_maxsize = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_sasl_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.password = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.proxies = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.redis_db = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.redis_server = localhost:6379 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.retry_attempts = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.retry_delay = 0.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.socket_keepalive_count = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.socket_keepalive_idle = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.socket_keepalive_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.socket_timeout = 1.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.tls_allowed_ciphers = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.tls_cafile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.tls_certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.tls_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.tls_keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cache.username = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] coordination.backend_url = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.asyncio_connection = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.asyncio_slave_connection = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.backend = sqlalchemy {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.connection = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.connection_debug = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.connection_parameters = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.connection_recycle_time = 3600 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.connection_trace = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.db_inc_retry_interval = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.db_max_retries = 20 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.db_max_retry_interval = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.db_retry_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.max_overflow = 50 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.max_pool_size = 5 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.max_retries = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.mysql_wsrep_sync_wait = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.pool_timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.retry_interval = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.slave_connection = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.sqlite_synchronous = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.synchronous_reader = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] database.use_db_reconnect = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.connection_string = messaging:// {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.es_doc_type = notification {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.es_scroll_size = 10000 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.es_scroll_time = 2m {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.filter_error_trace = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.hmac_keys = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.sentinel_service_name = mymaster {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.socket_timeout = 0.1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.trace_requests = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler.trace_sqlalchemy = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler_jaeger.process_tags = {} {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler_jaeger.service_name_prefix = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] profiler_otlp.service_name_prefix = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.enforce_new_defaults = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: WARNING oslo_config.cfg [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.enforce_scope = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.policy_default_rule = default {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.policy_file = policy.yaml {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_policy.remote_timeout = 60.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.group = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.helper_command = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] privsep_osbrick.user = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.group = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.helper_command = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] cinder_sys_admin.user = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.auth_section = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.auth_type = password {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.cafile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.collect_timing = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.send_service_user_token = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.split_loggers = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] service_user.timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.auth_section = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.auth_type = password {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.collect_timing = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.region_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.split_loggers = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] glance.timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.backend_availability_zone = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.chap_password = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.chap_username = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.disk_geometry = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_client_cert = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_client_cert_key = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_data_namespace = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.driver_use_ssl = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.extra_capabilities = {} {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.filter_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.goodness_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iscsi_target_flags = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iscsi_write_cache = on {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iser_helper = tgtadm {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iser_port = 3260 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.lvm_mirrors = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.lvm_share_target = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.lvm_type = auto {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.num_shell_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.replication_device = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.report_discard_supported = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.reserved_percentage = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_helper = tgtadm {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_port = 3260 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_protocol = iscsi {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.trace_flags = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.unique_fqdn_network = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.use_chap_auth = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_backend_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_clear = zero {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_clear_ionice = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_clear_size = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volume_group = cinder-volumes {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_reports.file_event_handler = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_reports.log_dir = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.backend_host = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.chap_password = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.chap_username = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.chiscsi_conf = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.disk_geometry = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_client_cert = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.driver_use_ssl = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.extra_capabilities = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.filter_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.goodness_function = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iser_helper = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iser_ip_address = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iser_port = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.lvm_conf_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.lvm_mirrors = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack sudo[73218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.lvm_share_target = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.lvm_type = auto {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack sudo[73218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.num_shell_tries = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.nvmet_port_id = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.replication_device = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.report_discard_supported = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.reserved_percentage = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.scst_target_driver = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.storage_protocol = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_helper = lioadm {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_ip_address = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_port = 3260 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_protocol = iscsi {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.trace_flags = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.use_chap_auth = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_clear = zero {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_clear_size = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] lvmdriver-1.volumes_dir = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.ssl_version = {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_notifications.driver = [] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_notifications.retry = -1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] key_manager.fixed_key = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.barbican_api_version = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.barbican_endpoint = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.barbican_endpoint_type = public {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.barbican_region_name = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.cafile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.collect_timing = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.number_of_retries = 60 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.retry_delay = 1 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.send_service_user_token = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.split_loggers = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.verify_ssl = True {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican.verify_ssl_path = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.auth_section = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.auth_type = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.cafile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.certfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.collect_timing = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.insecure = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.keyfile = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.split_loggers = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] barbican_service_user.timeout = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.approle_role_id = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.approle_secret_id = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.kv_mountpoint = secret {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.kv_path = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.kv_version = 2 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.namespace = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.root_token_id = **** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.ssl_ca_crt_file = None {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.timeout = 60.0 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.use_ssl = False {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:09:24 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] ******************************************************************************** {{(pid=73105) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 00:09:25 devstack sudo[73218]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.555s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:25 devstack sudo[73378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:25 devstack sudo[73378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:25 devstack sudo[73378]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.491s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:09:25 devstack cinder-volume[73213]: INFO cinder.brick.local_dev.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:25 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:25 devstack sudo[73591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:25 devstack sudo[73591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:26 devstack sudo[73591]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:26 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:26 devstack cinder-volume[73213]: DEBUG cinder.brick.local_dev.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73213) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 00:09:26 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:26 devstack sudo[73740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:26 devstack sudo[73740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:27 devstack sudo[73740]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.827s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:27 devstack sudo[73870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:27 devstack sudo[73870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:27 devstack sudo[73870]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.457s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:27 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:27 devstack sudo[73908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 00:09:27 devstack sudo[73908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:28 devstack sudo[73908]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:28 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.490s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:28 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:28 devstack sudo[73911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:28 devstack sudo[73911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:28 devstack sudo[73911]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:28 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:28 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:28 devstack sudo[73916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:28 devstack sudo[73916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:29 devstack sudo[73916]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:29 devstack sudo[73919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:29 devstack sudo[73919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:29 devstack sudo[73919]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:29 devstack sudo[73927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:29 devstack sudo[73927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:29 devstack sudo[73927]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:29 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:30 devstack sudo[73931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:30 devstack sudo[73931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:30 devstack sudo[73931]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:30 devstack cinder-volume[73213]: INFO cinder.volume.drivers.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:30 devstack sudo[73940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:30 devstack sudo[73940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:30 devstack sudo[73940]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:09:30 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:30 devstack sudo[74053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:30 devstack sudo[74053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:31 devstack sudo[74053]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:31 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:31 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:31 devstack sudo[74065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:31 devstack sudo[74065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:31 devstack sudo[74065]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:31 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:31 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:31 devstack sudo[74203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:31 devstack sudo[74203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:32 devstack sudo[74203]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:32 devstack sudo[74206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:32 devstack sudo[74206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:32 devstack sudo[74206]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:32 devstack cinder-volume[73213]: INFO cinder.volume.driver [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG cinder.volume.driver [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73213) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG oslo_db.sqlalchemy.engines [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73213) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG dbcounter [-] [73213] Writer thread running {{(pid=73213) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG cinder.db.sqlalchemy.api [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Building query based on filter {{(pid=73213) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG cinder.image.image_utils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73213) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 00:09:32 devstack cinder-volume[73213]: INFO cinder.keymgr.migration [None req-ed0ac3f9-5ba8-43c5-8658-b135550a298b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:09:32 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:32 devstack sudo[74213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:32 devstack sudo[74213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:33 devstack sudo[74213]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:33 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:33 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:33 devstack sudo[74216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:33 devstack sudo[74216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:33 devstack sudo[74216]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:33 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:33 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:33 devstack sudo[74222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:33 devstack sudo[74222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:34 devstack sudo[74222]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:34 devstack sudo[74226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:34 devstack sudo[74226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:34 devstack sudo[74226]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG cinder.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Notifying Schedulers of capabilities ... {{(pid=73213) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:09:34 devstack cinder-volume[73213]: INFO cinder.volume.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Driver initialization completed successfully. Apr 15 00:09:34 devstack cinder-volume[73213]: INFO cinder.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Initiating service 2 cleanup Apr 15 00:09:34 devstack cinder-volume[73213]: INFO cinder.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Service 2 cleanup completed. Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG cinder.service [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Creating RPC server for service cinder-volume {{(pid=73213) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG cinder.service [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73213) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 00:09:34 devstack cinder-volume[73213]: INFO cinder.volume.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:09:34 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:34 devstack cinder-volume[73105]: DEBUG dbcounter [-] [73105] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73105) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:09:34 devstack sudo[74230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:09:34 devstack sudo[74230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:35 devstack sudo[74230]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:35 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:35 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:35 devstack sudo[74237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:35 devstack sudo[74237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:35 devstack sudo[74237]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:35 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:35 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:35 devstack sudo[74243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:09:35 devstack sudo[74243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:36 devstack sudo[74243]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:36 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:36 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:09:36 devstack sudo[74300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:09:36 devstack sudo[74300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:09:36 devstack sudo[74300]: pam_unix(sudo:session): session closed for user root Apr 15 00:09:36 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:09:36 devstack cinder-volume[73213]: INFO cinder.volume.manager [None req-676d8a8f-d923-496e-8a80-54e4bd1fb5a2 None None] Driver post RPC initialization completed successfully. Apr 15 00:09:46 devstack cinder-volume[73213]: DEBUG dbcounter [-] [73213] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73213) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:09:46 devstack cinder-volume[73213]: DEBUG dbcounter [-] [73213] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73213) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:10:40 devstack cinder-volume[73213]: DEBUG oslo_service.periodic_task [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73213) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:10:40 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:10:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:10:40 devstack sudo[79430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:10:40 devstack sudo[79430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:10:40 devstack sudo[79430]: pam_unix(sudo:session): session closed for user root Apr 15 00:10:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:10:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:10:40 devstack sudo[79433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:10:40 devstack sudo[79433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:10:41 devstack sudo[79433]: pam_unix(sudo:session): session closed for user root Apr 15 00:10:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:10:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:10:41 devstack sudo[79436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:10:41 devstack sudo[79436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:10:41 devstack sudo[79436]: pam_unix(sudo:session): session closed for user root Apr 15 00:10:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:10:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:10:41 devstack sudo[79440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:10:41 devstack sudo[79440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:10:42 devstack sudo[79440]: pam_unix(sudo:session): session closed for user root Apr 15 00:10:42 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:10:42 devstack cinder-volume[73213]: DEBUG cinder.manager [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Notifying Schedulers of capabilities ... {{(pid=73213) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:11:40 devstack cinder-volume[73213]: DEBUG oslo_service.periodic_task [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73213) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:11:40 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:11:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:11:40 devstack sudo[80668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:11:40 devstack sudo[80668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:11:40 devstack sudo[80668]: pam_unix(sudo:session): session closed for user root Apr 15 00:11:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:11:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:11:40 devstack sudo[80696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:11:40 devstack sudo[80696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:11:41 devstack sudo[80696]: pam_unix(sudo:session): session closed for user root Apr 15 00:11:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:11:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:11:41 devstack sudo[80726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:11:41 devstack sudo[80726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:11:41 devstack sudo[80726]: pam_unix(sudo:session): session closed for user root Apr 15 00:11:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.449s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:11:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:11:41 devstack sudo[80750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:11:41 devstack sudo[80750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:11:42 devstack sudo[80750]: pam_unix(sudo:session): session closed for user root Apr 15 00:11:42 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:11:42 devstack cinder-volume[73213]: DEBUG cinder.manager [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Notifying Schedulers of capabilities ... {{(pid=73213) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:11:46 devstack cinder-volume[73213]: DEBUG dbcounter [-] [73213] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73213) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:12:40 devstack cinder-volume[73213]: DEBUG oslo_service.periodic_task [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73213) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:12:40 devstack cinder-volume[73213]: DEBUG cinder.volume.drivers.lvm [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Updating volume stats {{(pid=73213) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 00:12:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:40 devstack sudo[82288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 00:12:40 devstack sudo[82288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:40 devstack sudo[82288]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:40 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:40 devstack sudo[82312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:12:40 devstack sudo[82312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:41 devstack sudo[82312]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:41 devstack sudo[82320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 00:12:41 devstack sudo[82320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:41 devstack sudo[82320]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:41 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:41 devstack sudo[82323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 00:12:41 devstack sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:42 devstack sudo[82323]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:42 devstack cinder-volume[73213]: DEBUG oslo_concurrency.processutils [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73213) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:42 devstack cinder-volume[73213]: DEBUG cinder.manager [None req-dfdbd393-6126-42e6-b5ea-f663abdb6bc1 None None] Notifying Schedulers of capabilities ... {{(pid=73213) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:12:52 devstack cinder-volume[73105]: INFO oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Caught SIGTERM, stopping children Apr 15 00:12:52 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Acquiring lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:12:52 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Acquired lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:12:52 devstack cinder-volume[73105]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Releasing lock "singleton_lock" {{(pid=73105) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:12:52 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Stop services. {{(pid=73105) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 00:12:52 devstack cinder-volume[73105]: DEBUG oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Killing children. {{(pid=73105) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 00:12:52 devstack cinder-volume[73105]: INFO oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Waiting on 1 children to exit Apr 15 00:12:54 devstack cinder-volume[73213]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Acquiring lock "singleton_lock" {{(pid=73213) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:12:54 devstack cinder-volume[73213]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Acquired lock "singleton_lock" {{(pid=73213) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:12:54 devstack cinder-volume[73213]: DEBUG oslo_concurrency.lockutils [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Releasing lock "singleton_lock" {{(pid=73213) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:12:54 devstack cinder-volume[73213]: WARNING amqp [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 00:12:54 devstack cinder-volume[73213]: WARNING amqp [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 00:12:54 devstack cinder-volume[73105]: INFO oslo_service.backend._eventlet.service [None req-328e21ec-667d-4e49-a3f7-2c49e4439236 None None] Child 73213 exited with status 0 Apr 15 00:12:54 devstack cinder-volume[82669]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 00:12:54 devstack cinder-volume[82669]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 00:12:54 devstack cinder-volume[82669]: we strongly recommend against using it for new projects. Apr 15 00:12:54 devstack cinder-volume[82669]: If you are already using Eventlet, we recommend migrating to a different Apr 15 00:12:54 devstack cinder-volume[82669]: framework. For more detail see Apr 15 00:12:54 devstack cinder-volume[82669]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 00:12:54 devstack cinder-volume[82669]: import eventlet # noqa Apr 15 00:12:56 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:12:56 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:12:56 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:12:57 devstack cinder-volume[82669]: INFO dbcounter [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Registered counter for database cinder Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_db.sqlalchemy.engines [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG dbcounter [-] [82669] Writer thread running {{(pid=82669) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:12:57 devstack cinder-volume[82669]: INFO cinder.rpc [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 00:12:57 devstack cinder-volume[82669]: INFO cinder.rpc [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_db.sqlalchemy.engines [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:12:57 devstack cinder-volume[82669]: INFO cinder.volume.manager [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Determined volume DB was empty at startup. Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG cinder.volume.manager [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82669) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 00:12:57 devstack cinder-volume[82669]: INFO cinder.volume.manager [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 00:12:57 devstack cinder-volume[82669]: WARNING stevedore.named [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 00:12:57 devstack cinder-volume[82669]: WARNING castellan.key_manager [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:12:57 devstack cinder-volume[82669]: WARNING cinder.keymgr.conf_key_mgr [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:12:57 devstack cinder-volume[82669]: INFO cinder.volume.manager [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_db.sqlalchemy.engines [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82669) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:12:57 devstack cinder-volume[82669]: INFO oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Starting 1 workers Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Started child 82785 {{(pid=82669) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Full set of CONF: {{(pid=82669) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] ******************************************************************************** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Configuration options gathered from: {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] ================================================================================ {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] allow_availability_zone_fallback = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] allow_compression_on_image_upload = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] allowed_direct_url_schemes = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] api_rate_limit = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] auth_strategy = keystone {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_availability_zone = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_host = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_stats_polling_interval = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backup_api_class = cinder.backup.api.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backup_name_template = backup-%s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backup_use_same_host = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backup_use_temp_snapshot = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] chap_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] chap_username = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_internal_tenant_project_id = a570808b1f58478e9fc2a203f840e287 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_internal_tenant_user_id = 59212e5e579749b6baa11af8ac99cf4c {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cluster = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] compression_format = gzip {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] compute_api_class = cinder.compute.nova.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] config_dir = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] config_source = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] control_exchange = openstack {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] debug = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] default_availability_zone = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] default_group_type = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82785]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] default_volume_type = QuobyteHD {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] disk_geometry = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_client_cert = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_client_cert_key = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_data_namespace = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_ssl_cert_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_ssl_cert_verify = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] driver_use_ssl = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] enable_new_services = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] enable_unsupported_driver = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] enabled_backends = ['QuobyteHD'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] enforce_multipath_for_image_xfer = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] filter_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_api_insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_api_servers = ['http://192.168.122.105/image'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_api_ssl_compression = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_ca_certificates_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_catalog_info = image:glance:publicURL {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_num_retries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance_request_timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] goodness_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] graceful_shutdown_timeout = 5 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] group_api_class = cinder.group.api.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] host = devstack {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_compress_on_upload = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_conversion_address_space_limit = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_conversion_cpu_limit = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_conversion_disable = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_upload_use_cinder_backend = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_upload_use_internal_tenant = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_volume_cache_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_volume_cache_max_count = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] image_volume_cache_max_size_gb = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] init_host_max_objects_retrieval = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] instance_format = [instance: %(uuid)s] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iscsi_target_flags = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iscsi_write_cache = on {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iser_helper = tgtadm {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iser_ip_address = 192.168.122.105 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iser_port = 3260 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_color = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_config_append = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_dir = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_options = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_rotate_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_rotate_interval_type = days {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] log_rotation_type = none {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] max_age = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] max_logfile_count = 30 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] max_logfile_size_mb = 200 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] max_over_subscription_ratio = 20.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] message_reap_interval = 86400 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] message_ttl = 2592000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] migration_create_volume_timeout_secs = 300 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] monkey_patch = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] monkey_patch_modules = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] my_ip = 192.168.122.105 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] no_snapshot_gb_quota = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] num_iser_scan_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] num_shell_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] num_volume_device_scan_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] nvmeof_conn_info_version = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] nvmet_ns_id = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] nvmet_port_id = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_max_limit = 1000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_ext_list = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_listen_port = 8776 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_use_ssl = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] osapi_volume_workers = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] per_volume_size_limit = -1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] periodic_fuzzy_delay = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] periodic_interval = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] public_endpoint = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] publish_errors = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_backup_gigabytes = 1000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_backups = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_gigabytes = 1000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_groups = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_snapshots = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] quota_volumes = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] rate_limit_burst = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] rate_limit_except_level = CRITICAL {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] rate_limit_interval = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82785]: INFO cinder.volume.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] reinit_driver_count = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.remotefs [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82785) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] replication_device = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] report_discard_supported = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] report_interval = 120 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] reservation_clean_interval = 86400 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] reservation_expire = 86400 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] reserved_image_namespaces = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] reserved_percentage = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] rpc_response_timeout = 120 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] run_external_periodic_tasks = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] scst_target_driver = iscsi {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] scst_target_iqn_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_down_time = 720 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] shell_completion = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] snapshot_name_template = snapshot-%s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] split_loggers = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] state_path = /opt/stack/data/cinder {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] storage_availability_zone = nova {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] storage_protocol = iSCSI {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] syslog_log_facility = LOG_USER {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_helper = lioadm {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_ip_address = 192.168.122.105 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_port = 3260 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_protocol = iscsi {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] target_secondary_ip_addresses = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] trace_flags = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] transport_url = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] until_refresh = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_chap_auth = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_default_quota_class = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_journal = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_json = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_multipath_for_image_xfer = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_stderr = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] use_syslog = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] verify_glance_signatures = enabled {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_api_class = cinder.volume.api.API {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_backend_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_clear = zero {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_clear_ionice = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_clear_size = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_copy_bps_limit = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_dd_blocksize = 1M {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_name_template = volume-%s {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_service_inithost_offload = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volume_usage_audit_period = month {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] zoning_mode = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_concurrency.disable_process_locking = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.admin_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.admin_token = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.admin_user = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_port = 35357 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_protocol = https {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_section = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_type = password {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_uri = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.auth_version = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.cache = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.identity_uri = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.include_service_catalog = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.interface = public {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_password = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcache_username = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.region_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.service_type = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.backend = dogpile.cache.null {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.backend_argument = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.backend_expiration_time = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.config_prefix = cache.oslo {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.debug_cache_backend = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.enable_retry_client = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.enable_socket_keepalive = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.enforce_fips_mode = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.expiration_time = 600 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.hashclient_retry_attempts = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_dead_retry = 300 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_pool_maxsize = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_sasl_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.proxies = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.redis_db = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.redis_server = localhost:6379 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.retry_attempts = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.retry_delay = 0.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.socket_keepalive_count = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.socket_keepalive_idle = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.socket_keepalive_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.socket_timeout = 1.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.tls_allowed_ciphers = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.tls_cafile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.tls_certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.tls_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.tls_keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cache.username = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] coordination.backend_url = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.asyncio_connection = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.asyncio_slave_connection = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.backend = sqlalchemy {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.connection = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.connection_debug = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.connection_parameters = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.connection_recycle_time = 3600 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.connection_trace = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.db_inc_retry_interval = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.db_max_retries = 20 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.db_max_retry_interval = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.db_retry_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.max_overflow = 50 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.max_pool_size = 5 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.max_retries = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.mysql_wsrep_sync_wait = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.pool_timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.retry_interval = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.slave_connection = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.sqlite_synchronous = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.synchronous_reader = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] database.use_db_reconnect = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.connection_string = messaging:// {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.es_doc_type = notification {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.es_scroll_size = 10000 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.es_scroll_time = 2m {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.filter_error_trace = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.hmac_keys = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.sentinel_service_name = mymaster {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.socket_timeout = 0.1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.trace_requests = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler.trace_sqlalchemy = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler_jaeger.process_tags = {} {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler_jaeger.service_name_prefix = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] profiler_otlp.service_name_prefix = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.enforce_new_defaults = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: WARNING oslo_config.cfg [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.enforce_scope = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.policy_default_rule = default {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.policy_file = policy.yaml {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82785) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.group = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.helper_command = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82785]: WARNING cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82785]: WARNING cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] privsep_osbrick.user = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.group = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.helper_command = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Running cmd (subprocess): mount.quobyte {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] cinder_sys_admin.user = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.auth_section = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.auth_type = password {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.cafile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.collect_timing = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.send_service_user_token = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.split_loggers = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] service_user.timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.auth_section = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.auth_type = password {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.collect_timing = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.region_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.split_loggers = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] glance.timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.backend_availability_zone = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.chap_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.chap_username = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.disk_geometry = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_client_cert = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_client_cert_key = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_data_namespace = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.driver_use_ssl = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.extra_capabilities = {} {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.filter_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.goodness_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iscsi_target_flags = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iscsi_write_cache = on {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iser_helper = tgtadm {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iser_port = 3260 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_host = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_login = admin {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_mount_options = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_private_key = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_share_path = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.num_shell_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.quobyte_volume_url = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.replication_device = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.report_discard_supported = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.reserved_percentage = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_helper = tgtadm {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_port = 3260 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_protocol = iscsi {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.trace_flags = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.unique_fqdn_network = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.use_chap_auth = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_backend_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_clear = zero {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_clear_ionice = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_clear_size = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_reports.file_event_handler = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_reports.log_dir = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.backend_availability_zone = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.backend_host = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.chap_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.chap_username = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.chiscsi_conf = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.disk_geometry = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_client_cert = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_data_namespace = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.driver_use_ssl = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.extra_capabilities = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.filter_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.goodness_function = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iser_helper = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iser_ip_address = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iser_port = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.iser_target_prefix = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_host = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_login = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_mount_options = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_password = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_private_key = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_share_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_ssh_port = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.num_shell_tries = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.nvmet_port_id = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.replication_device = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.report_discard_supported = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.reserved_percentage = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.scst_target_driver = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.storage_protocol = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_helper = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_ip_address = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_port = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_prefix = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_protocol = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.trace_flags = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.use_chap_auth = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_clear = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_clear_size = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] QuobyteHD.volumes_dir = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_notifications.driver = [] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_notifications.retry = -1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] key_manager.fixed_key = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.barbican_api_version = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.barbican_endpoint = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.barbican_endpoint_type = public {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.barbican_region_name = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.cafile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.collect_timing = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.number_of_retries = 60 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.retry_delay = 1 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.send_service_user_token = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.split_loggers = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.verify_ssl = True {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican.verify_ssl_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.auth_section = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.auth_type = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.cafile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.certfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.collect_timing = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.insecure = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.keyfile = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.split_loggers = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] barbican_service_user.timeout = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.approle_role_id = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.approle_secret_id = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.kv_mountpoint = secret {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.kv_path = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.kv_version = 2 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.namespace = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.root_token_id = **** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.ssl_ca_crt_file = None {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.timeout = 60.0 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.use_ssl = False {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:12:57 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] ******************************************************************************** {{(pid=82669) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 00:12:57 devstack quobyte-client[82788]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 00:12:57 devstack quobyte-client[82788]: Invalid parameters found, error: missing mount point. Apr 15 00:12:57 devstack quobyte-client[82788]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 00:12:57 devstack quobyte-client[82788]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=82785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:12:57 devstack cinder-volume[82785]: INFO cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 ... Apr 15 00:12:57 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 -c /etc/quobyte/client-cinder.cfg {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:57 devstack sudo[82789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 -c /etc/quobyte/client-cinder.cfg Apr 15 00:12:57 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:58 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.515s {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:58 devstack cinder-volume[82785]: INFO cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 succeeded Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=82785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.540s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:58 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:12:58 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:58 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.372s {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:58 devstack cinder-volume[82785]: INFO cinder.volume.driver [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.volume.driver [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82785) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_db.sqlalchemy.engines [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82785) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG dbcounter [-] [82785] Writer thread running {{(pid=82785) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.db.sqlalchemy.api [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Building query based on filter {{(pid=82785) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.image.image_utils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82785) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 00:12:58 devstack cinder-volume[82785]: INFO cinder.keymgr.migration [None req-64d73744-f3b2-4908-b8b5-33bdb534215b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=82785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=82785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:12:58 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:58 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:12:58 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:59 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.390s {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG cinder.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Notifying Schedulers of capabilities ... {{(pid=82785) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:12:59 devstack cinder-volume[82785]: INFO cinder.volume.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Driver initialization completed successfully. Apr 15 00:12:59 devstack cinder-volume[82785]: INFO cinder.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Initiating service 3 cleanup Apr 15 00:12:59 devstack cinder-volume[82785]: INFO cinder.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Service 3 cleanup completed. Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG cinder.service [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Creating RPC server for service cinder-volume {{(pid=82785) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG cinder.service [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82785) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 00:12:59 devstack cinder-volume[82785]: INFO cinder.volume.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=82785) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG cinder.volume.drivers.quobyte [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=82785) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82785) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:12:59 devstack sudo[82865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:12:59 devstack sudo[82865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:12:59 devstack sudo[82865]: pam_unix(sudo:session): session closed for user root Apr 15 00:12:59 devstack cinder-volume[82785]: DEBUG oslo_concurrency.processutils [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.395s {{(pid=82785) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:12:59 devstack cinder-volume[82785]: INFO cinder.volume.manager [None req-6e45b4e4-6554-49ee-ac6d-f16158733117 None None] Driver post RPC initialization completed successfully. Apr 15 00:13:01 devstack cinder-volume[82669]: INFO oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Caught SIGTERM, stopping children Apr 15 00:13:01 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Acquiring lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:13:01 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Acquired lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:13:01 devstack cinder-volume[82669]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Releasing lock "singleton_lock" {{(pid=82669) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:13:01 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Stop services. {{(pid=82669) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 00:13:01 devstack cinder-volume[82669]: DEBUG oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Killing children. {{(pid=82669) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 00:13:01 devstack cinder-volume[82669]: INFO oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Waiting on 1 children to exit Apr 15 00:13:03 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Acquiring lock "singleton_lock" {{(pid=82785) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:13:03 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Acquired lock "singleton_lock" {{(pid=82785) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:13:03 devstack cinder-volume[82785]: DEBUG oslo_concurrency.lockutils [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Releasing lock "singleton_lock" {{(pid=82785) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:13:03 devstack cinder-volume[82785]: WARNING amqp [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 00:13:03 devstack cinder-volume[82785]: WARNING amqp [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 00:13:03 devstack cinder-volume[82669]: INFO oslo_service.backend._eventlet.service [None req-792638f8-2010-4bb1-94c0-21c5acf5a681 None None] Child 82785 exited with status 0 Apr 15 00:13:03 devstack cinder-volume[83007]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 00:13:03 devstack cinder-volume[83007]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 00:13:03 devstack cinder-volume[83007]: we strongly recommend against using it for new projects. Apr 15 00:13:03 devstack cinder-volume[83007]: If you are already using Eventlet, we recommend migrating to a different Apr 15 00:13:03 devstack cinder-volume[83007]: framework. For more detail see Apr 15 00:13:03 devstack cinder-volume[83007]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 00:13:03 devstack cinder-volume[83007]: import eventlet # noqa Apr 15 00:13:05 devstack cinder-volume[83007]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 00:13:05 devstack cinder-volume[83007]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 00:13:05 devstack cinder-volume[83007]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83007) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 00:13:06 devstack cinder-volume[83007]: INFO dbcounter [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Registered counter for database cinder Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_db.sqlalchemy.engines [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG dbcounter [-] [83007] Writer thread running {{(pid=83007) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:13:06 devstack cinder-volume[83007]: INFO cinder.rpc [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 00:13:06 devstack cinder-volume[83007]: INFO cinder.rpc [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_db.sqlalchemy.engines [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:13:06 devstack cinder-volume[83007]: INFO cinder.volume.manager [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Determined volume DB was empty at startup. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG cinder.volume.manager [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83007) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 00:13:06 devstack cinder-volume[83007]: WARNING stevedore.named [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 00:13:06 devstack cinder-volume[83007]: WARNING castellan.key_manager [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:13:06 devstack cinder-volume[83007]: WARNING cinder.keymgr.conf_key_mgr [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 00:13:06 devstack cinder-volume[83007]: INFO cinder.volume.manager [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_db.sqlalchemy.engines [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83007) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:13:06 devstack cinder-volume[83007]: INFO oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Starting 1 workers Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Started child 83219 {{(pid=83007) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Full set of CONF: {{(pid=83007) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] ******************************************************************************** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Configuration options gathered from: {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] ================================================================================ {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] allow_availability_zone_fallback = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] allow_compression_on_image_upload = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] allowed_direct_url_schemes = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] api_rate_limit = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83219]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] auth_strategy = keystone {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_availability_zone = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_host = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_stats_polling_interval = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backup_api_class = cinder.backup.api.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backup_name_template = backup-%s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backup_use_same_host = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backup_use_temp_snapshot = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] chap_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] chap_username = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_internal_tenant_project_id = a570808b1f58478e9fc2a203f840e287 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_internal_tenant_user_id = 59212e5e579749b6baa11af8ac99cf4c {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cluster = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] compression_format = gzip {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] compute_api_class = cinder.compute.nova.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] config_dir = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] config_source = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] control_exchange = openstack {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] debug = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] default_availability_zone = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] default_group_type = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] default_volume_type = QuobyteHD {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] disk_geometry = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_client_cert = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_client_cert_key = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_data_namespace = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_ssl_cert_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_ssl_cert_verify = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] driver_use_ssl = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] enable_new_services = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] enable_unsupported_driver = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] enabled_backends = ['QuobyteHD'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] enforce_multipath_for_image_xfer = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] filter_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_api_insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_api_servers = ['http://192.168.122.105/image'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_api_ssl_compression = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_ca_certificates_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_catalog_info = image:glance:publicURL {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_num_retries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance_request_timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] goodness_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] graceful_shutdown_timeout = 5 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] group_api_class = cinder.group.api.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] host = devstack {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_compress_on_upload = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_conversion_address_space_limit = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_conversion_cpu_limit = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_conversion_disable = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_upload_use_cinder_backend = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_upload_use_internal_tenant = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_volume_cache_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_volume_cache_max_count = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] image_volume_cache_max_size_gb = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] init_host_max_objects_retrieval = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] instance_format = [instance: %(uuid)s] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iscsi_target_flags = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iscsi_write_cache = on {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iser_helper = tgtadm {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iser_ip_address = 192.168.122.105 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iser_port = 3260 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_color = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_config_append = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_dir = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_options = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_rotate_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_rotate_interval_type = days {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] log_rotation_type = none {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] max_age = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] max_logfile_count = 30 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] max_logfile_size_mb = 200 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] max_over_subscription_ratio = 20.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] message_reap_interval = 86400 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] message_ttl = 2592000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] migration_create_volume_timeout_secs = 300 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83219) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] monkey_patch = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] monkey_patch_modules = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] my_ip = 192.168.122.105 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] no_snapshot_gb_quota = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] num_iser_scan_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] num_shell_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] num_volume_device_scan_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] nvmeof_conn_info_version = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] nvmet_ns_id = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] nvmet_port_id = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_max_limit = 1000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_ext_list = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_listen_port = 8776 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_use_ssl = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] osapi_volume_workers = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] per_volume_size_limit = -1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] periodic_fuzzy_delay = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] periodic_interval = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] public_endpoint = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] publish_errors = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_backup_gigabytes = 1000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_backups = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_gigabytes = 1000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_groups = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_snapshots = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] quota_volumes = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] rate_limit_burst = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] rate_limit_except_level = CRITICAL {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] rate_limit_interval = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] reinit_driver_count = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] replication_device = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] report_discard_supported = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] report_interval = 120 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] reservation_clean_interval = 86400 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] reservation_expire = 86400 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] reserved_image_namespaces = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] reserved_percentage = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] rpc_response_timeout = 120 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] run_external_periodic_tasks = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] scst_target_driver = iscsi {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] scst_target_iqn_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_down_time = 720 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] shell_completion = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] snapshot_name_template = snapshot-%s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] split_loggers = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] state_path = /opt/stack/data/cinder {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] storage_availability_zone = nova {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] storage_protocol = iSCSI {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] syslog_log_facility = LOG_USER {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_helper = lioadm {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_ip_address = 192.168.122.105 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_port = 3260 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_protocol = iscsi {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] target_secondary_ip_addresses = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] trace_flags = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] transport_url = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] until_refresh = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_chap_auth = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_default_quota_class = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_journal = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_json = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_multipath_for_image_xfer = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_stderr = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] use_syslog = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] verify_glance_signatures = enabled {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_api_class = cinder.volume.api.API {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_backend_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_clear = zero {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_clear_ionice = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_clear_size = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_copy_bps_limit = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_dd_blocksize = 1M {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_name_template = volume-%s {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_service_inithost_offload = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volume_usage_audit_period = month {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] zoning_mode = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_concurrency.disable_process_locking = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.admin_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.admin_token = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.admin_user = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_port = 35357 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_protocol = https {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_section = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_type = password {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_uri = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.auth_version = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.cache = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.identity_uri = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.include_service_catalog = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.interface = public {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_password = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcache_username = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.region_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.service_type = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.105/identity {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.backend = dogpile.cache.null {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.backend_argument = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.backend_expiration_time = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.config_prefix = cache.oslo {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.debug_cache_backend = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.enable_retry_client = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.enable_socket_keepalive = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.enforce_fips_mode = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.expiration_time = 600 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.hashclient_retry_attempts = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_dead_retry = 300 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_pool_maxsize = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_sasl_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.proxies = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.redis_db = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.redis_server = localhost:6379 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.retry_attempts = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.retry_delay = 0.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.socket_keepalive_count = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.socket_keepalive_idle = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.socket_keepalive_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.socket_timeout = 1.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.tls_allowed_ciphers = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83219) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 00:13:06 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.tls_cafile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.tls_certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.tls_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.tls_keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cache.username = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] coordination.backend_url = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.asyncio_connection = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.asyncio_slave_connection = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.backend = sqlalchemy {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.connection = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.connection_debug = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Running cmd (subprocess): mount.quobyte {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.connection_parameters = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.connection_recycle_time = 3600 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.connection_trace = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.db_inc_retry_interval = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.db_max_retries = 20 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.db_max_retry_interval = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.db_retry_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.max_overflow = 50 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.max_pool_size = 5 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.max_retries = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.mysql_wsrep_sync_wait = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.pool_timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.retry_interval = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.slave_connection = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.sqlite_synchronous = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.synchronous_reader = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] database.use_db_reconnect = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.connection_string = messaging:// {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.es_doc_type = notification {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.es_scroll_size = 10000 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.es_scroll_time = 2m {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.filter_error_trace = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.hmac_keys = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.sentinel_service_name = mymaster {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.socket_timeout = 0.1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.trace_requests = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler.trace_sqlalchemy = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler_jaeger.process_tags = {} {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler_jaeger.service_name_prefix = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] profiler_otlp.service_name_prefix = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.enforce_new_defaults = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: WARNING oslo_config.cfg [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.enforce_scope = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.policy_default_rule = default {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.policy_file = policy.yaml {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.group = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.helper_command = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] privsep_osbrick.user = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.group = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.helper_command = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] cinder_sys_admin.user = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.auth_section = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.auth_type = password {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.cafile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.collect_timing = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.send_service_user_token = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.split_loggers = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] service_user.timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.auth_section = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.auth_type = password {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.collect_timing = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.region_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.split_loggers = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] glance.timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.backend_availability_zone = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.chap_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.chap_username = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.disk_geometry = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_client_cert = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_client_cert_key = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_data_namespace = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.driver_use_ssl = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.extra_capabilities = {} {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.filter_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.goodness_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iscsi_target_flags = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iscsi_write_cache = on {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iser_helper = tgtadm {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iser_ip_address = 192.168.122.105 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iser_port = 3260 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_host = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_login = admin {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_mount_options = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_private_key = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_share_path = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.num_shell_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.quobyte_volume_url = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.replication_device = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.report_discard_supported = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.reserved_percentage = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_helper = tgtadm {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_ip_address = 192.168.122.105 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_port = 3260 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_protocol = iscsi {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.trace_flags = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.unique_fqdn_network = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.use_chap_auth = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_backend_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_clear = zero {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_clear_ionice = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_clear_size = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_reports.file_event_handler = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_reports.log_dir = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.backend_availability_zone = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.backend_host = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.chap_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.chap_username = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.chiscsi_conf = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.disk_geometry = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_client_cert = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_data_namespace = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.driver_use_ssl = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack quobyte-client[83230]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.extra_capabilities = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.filter_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack quobyte-client[83230]: Invalid parameters found, error: missing mount point. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.goodness_function = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack quobyte-client[83230]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack quobyte-client[83230]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iser_helper = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iser_ip_address = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iser_port = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.iser_target_prefix = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_host = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_login = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_mount_options = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_password = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_private_key = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_share_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_ssh_port = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.num_shell_tries = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.nvmet_port_id = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.replication_device = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.report_discard_supported = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.reserved_percentage = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.scst_target_driver = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.storage_protocol = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_helper = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_ip_address = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_port = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_prefix = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_protocol = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.trace_flags = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.use_chap_auth = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_clear = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_clear_size = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] QuobyteHD.volumes_dir = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_notifications.driver = [] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_notifications.retry = -1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] key_manager.fixed_key = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.barbican_api_version = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.barbican_endpoint = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.barbican_endpoint_type = public {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.barbican_region_name = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.cafile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.collect_timing = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.number_of_retries = 60 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.retry_delay = 1 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.send_service_user_token = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.split_loggers = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.verify_ssl = True {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican.verify_ssl_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.auth_section = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.auth_type = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.cafile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.certfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.collect_timing = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.insecure = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.keyfile = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.split_loggers = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] barbican_service_user.timeout = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack sudo[83232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.approle_role_id = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.approle_secret_id = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.kv_mountpoint = secret {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.kv_path = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack sudo[83232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.kv_version = 2 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.namespace = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.root_token_id = **** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.ssl_ca_crt_file = None {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.timeout = 60.0 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.use_ssl = False {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 00:13:06 devstack cinder-volume[83007]: DEBUG oslo_service.backend._eventlet.service [None req-ac993245-89e1-4498-9973-e0d851a8b9b6 None None] ******************************************************************************** {{(pid=83007) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 00:13:07 devstack sudo[83232]: pam_unix(sudo:session): session closed for user root Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.389s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.volume.driver [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Driver hasn't implemented _init_vendor_properties() Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.volume.driver [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83219) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83219) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writer thread running {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.db.sqlalchemy.api [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Building query based on filter {{(pid=83219) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83219) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.keymgr.migration [None req-0989ad4c-b070-4afa-82d6-f8246bb67387 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 00:13:07 devstack sudo[83249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:13:07 devstack sudo[83249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:13:07 devstack sudo[83249]: pam_unix(sudo:session): session closed for user root Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.391s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Driver initialization completed successfully. Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Initiating service 3 cleanup Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Service 3 cleanup completed. Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.service [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Creating RPC server for service cinder-volume {{(pid=83219) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.service [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83219) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 00:13:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:13:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:13:07 devstack sudo[83252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:13:07 devstack sudo[83252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:13:08 devstack sudo[83252]: pam_unix(sudo:session): session closed for user root Apr 15 00:13:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.391s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:13:08 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9c1f4eea-674c-4cb0-a19f-68a3f0c48bbd None None] Driver post RPC initialization completed successfully. Apr 15 00:13:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f7d70fe8-d13c-47b2-85d1-67223f06794f tempest-BackendsCapabilitiesAdminTestsJSON-1727012514 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83219) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 00:13:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4248377b-187c-42b5-9bf1-2ce78cbda6e8 tempest-BackendsCapabilitiesAdminTestsJSON-1727012514 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83219) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 00:13:16 devstack cinder-volume[83007]: DEBUG dbcounter [-] [83007] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83007) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:13:17 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:13:18 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=4 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5b68e27c-1f47-4cff-8c24-ef9a01da5aab tempest-GroupsTest-1037552755 None] Group tempest-Group1-435685682: creating Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5b68e27c-1f47-4cff-8c24-ef9a01da5aab tempest-GroupsTest-1037552755 None] Group tempest-Group1-435685682: created successfully Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5b68e27c-1f47-4cff-8c24-ef9a01da5aab tempest-GroupsTest-1037552755 None] Create group completed successfully. Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-682076c2-2471-4b65-9f5d-133063fb3393 tempest-GroupSnapshotsV319Test-425038103 None] Group tempest-GroupSnapshotsV319Test-Group-1886945705: creating Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-682076c2-2471-4b65-9f5d-133063fb3393 tempest-GroupSnapshotsV319Test-425038103 None] Group tempest-GroupSnapshotsV319Test-Group-1886945705: created successfully Apr 15 00:14:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-682076c2-2471-4b65-9f5d-133063fb3393 tempest-GroupSnapshotsV319Test-425038103 None] Create group completed successfully. Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Flow 'volume_create_manager' (eea9a40b-1d2c-4a33-b4e7-543043a1bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15096a69-9b55-4931-a5be-94139296708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15096a69-9b55-4931-a5be-94139296708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:06Z,deleted=False,deleted_at=None,display_description='',display_name='81753605-7ee6-472c-8601-c79e88bd2a38-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be42595-16a7-45d2-aaf6-aed535bdeab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752149c55bdf4afe896a2ac740056889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:06Z,use_quota=True,user_id='ea3004c9ade9487e94079dd543daceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d31b95-301a-4217-906a-17608452925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d31b95-301a-4217-906a-17608452925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0c4a1-5552-4f37-8450-451cbd08e3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0c4a1-5552-4f37-8450-451cbd08e3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be42595-16a7-45d2-aaf6-aed535bdeab3', 'volume_name': 'volume-2be42595-16a7-45d2-aaf6-aed535bdeab3', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ca00dc-a123-4e8a-a844-6719f1ab7615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ca00dc-a123-4e8a-a844-6719f1ab7615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741e644-cb92-4c50-87b3-1e83631e48d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume 2be42595-16a7-45d2-aaf6-aed535bdeab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be42595-16a7-45d2-aaf6-aed535bdeab3', 'volume_size': 1} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:06Z,deleted=False,deleted_at=None,display_description='',display_name='81753605-7ee6-472c-8601-c79e88bd2a38-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be42595-16a7-45d2-aaf6-aed535bdeab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752149c55bdf4afe896a2ac740056889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:06Z,use_quota=True,user_id='ea3004c9ade9487e94079dd543daceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Creating volume 2be42595-16a7-45d2-aaf6-aed535bdeab3 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:06 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:06 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 1073741824 Apr 15 00:14:06 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0d5ff44b-94df-4bd2-a345-4611cb490916 tempest-GroupsTest-1037552755 None] Group tempest-Group2-792679614: creating Apr 15 00:14:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0d5ff44b-94df-4bd2-a345-4611cb490916 tempest-GroupsTest-1037552755 None] Group tempest-Group2-792679614: created successfully Apr 15 00:14:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0d5ff44b-94df-4bd2-a345-4611cb490916 tempest-GroupsTest-1037552755 None] Create group completed successfully. Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Flow 'volume_create_manager' (2e1c318a-eed8-4032-bf37-6727ee32b256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c14c17-9809-4dc1-885e-d66f9b8b9046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c14c17-9809-4dc1-885e-d66f9b8b9046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2112269306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f260dd7f-c6df-4326-8134-431f621d407d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db03037a6e4b798323ee58b00df85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:07Z,use_quota=True,user_id='1cec48dfd2ee4d0cb78071aa793b1dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34093ed2-980d-4e90-b4d1-f88fe7c1eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34093ed2-980d-4e90-b4d1-f88fe7c1eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fca5108-a0e4-4cf6-9f7a-f08913c5e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fca5108-a0e4-4cf6-9f7a-f08913c5e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f260dd7f-c6df-4326-8134-431f621d407d', 'volume_name': 'volume-f260dd7f-c6df-4326-8134-431f621d407d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffd0b06-5770-4823-b38f-bc97dc521ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffd0b06-5770-4823-b38f-bc97dc521ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd5e25d-d212-42f8-aed2-b70930e27b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Volume f260dd7f-c6df-4326-8134-431f621d407d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f260dd7f-c6df-4326-8134-431f621d407d', 'volume_size': 1} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Flow 'volume_create_manager' (f659253c-280f-431d-bef7-d36a4da57e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d71f36-2061-4c37-9149-84220ace4288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d71f36-2061-4c37-9149-84220ace4288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621039448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa5e25-c1c3-4b85-9922-3bdc9b7bffc7,host='devstack@QuobyteHD#QuobyteHD',id=c6015de2-af40-4c9a-bb50-26d498654355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2902fee33a0c40a5ba7e1936ae6a86ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:07Z,use_quota=True,user_id='af3d946837304a3e824478c129ac838f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45b13109-af79-41ec-ba48-04be3d21fa80),volume_type_id=45b13109-af79-41ec-ba48-04be3d21fa80)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0292a0ba-cdf4-4529-b387-88070db94b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0292a0ba-cdf4-4529-b387-88070db94b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd1a492-51a3-4a1e-b920-01844e852707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd1a492-51a3-4a1e-b920-01844e852707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6015de2-af40-4c9a-bb50-26d498654355', 'volume_name': 'volume-c6015de2-af40-4c9a-bb50-26d498654355', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6f070-73a4-4a78-9306-2f2529fcfc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a6f070-73a4-4a78-9306-2f2529fcfc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7669e1-afa8-48db-a795-0773b553967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Volume c6015de2-af40-4c9a-bb50-26d498654355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6015de2-af40-4c9a-bb50-26d498654355', 'volume_size': 1} Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:07 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 1073741824" returned: 0 in 1.259s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:08 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 Apr 15 00:14:08 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (9d3a07cd-d0ad-41a1-87b8-95a2ceccf26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9497a3eb-c97a-440f-8169-01eca5e0f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9497a3eb-c97a-440f-8169-01eca5e0f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388688012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e6d3a65-212d-4c22-96cd-aedc4aee25ba,host='devstack@QuobyteHD#QuobyteHD',id=4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:08Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6859e279-6c43-4735-ac63-ec53078b8f26),volume_type_id=6859e279-6c43-4735-ac63-ec53078b8f26)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82af3ed8-0a8b-4a4d-a5d4-c9043ee2bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82af3ed8-0a8b-4a4d-a5d4-c9043ee2bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0fb7d6-3940-4998-8a56-7630e81e7ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0fb7d6-3940-4998-8a56-7630e81e7ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4', 'volume_name': 'volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090e75c4-4085-49f8-9119-c1d52ff915ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090e75c4-4085-49f8-9119-c1d52ff915ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d0f6b8-d61f-47eb-82d4-6bf60b70c6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Volume 4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4', 'volume_size': 1} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:08 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3" returned: 0 in 0.502s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2112269306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f260dd7f-c6df-4326-8134-431f621d407d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db03037a6e4b798323ee58b00df85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:07Z,use_quota=True,user_id='1cec48dfd2ee4d0cb78071aa793b1dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Creating volume f260dd7f-c6df-4326-8134-431f621d407d {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:08 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:08 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d 1073741824 Apr 15 00:14:08 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4741e644-cb92-4c50-87b3-1e83631e48d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be42595-16a7-45d2-aaf6-aed535bdeab3', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f8fffd-6edb-43ce-8542-5a2f0eb4e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 (2be42595-16a7-45d2-aaf6-aed535bdeab3): created successfully Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f8fffd-6edb-43ce-8542-5a2f0eb4e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Flow 'volume_create_manager' (eea9a40b-1d2c-4a33-b4e7-543043a1bb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:08 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-f036cb40-b7a6-4f26-bbe7-eb21e6be9578 tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Created volume successfully. Apr 15 00:14:09 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d 1073741824" returned: 0 in 0.676s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:09 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d Apr 15 00:14:09 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:09 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d" returned: 0 in 0.586s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2efa5e25-c1c3-4b85-9922-3bdc9b7bffc7,created_at=2026-04-14T22:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621039448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2efa5e25-c1c3-4b85-9922-3bdc9b7bffc7,host='devstack@QuobyteHD#QuobyteHD',id=c6015de2-af40-4c9a-bb50-26d498654355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2902fee33a0c40a5ba7e1936ae6a86ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:07Z,use_quota=True,user_id='af3d946837304a3e824478c129ac838f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45b13109-af79-41ec-ba48-04be3d21fa80),volume_type_id=45b13109-af79-41ec-ba48-04be3d21fa80)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Creating volume c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:09 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd5e25d-d212-42f8-aed2-b70930e27b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f260dd7f-c6df-4326-8134-431f621d407d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fe9183-10a6-4582-9d3e-950a7a5bae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:09 devstack sudo[84056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 1073741824 Apr 15 00:14:09 devstack sudo[84056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Volume volume-f260dd7f-c6df-4326-8134-431f621d407d (f260dd7f-c6df-4326-8134-431f621d407d): created successfully Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fe9183-10a6-4582-9d3e-950a7a5bae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Flow 'volume_create_manager' (2e1c318a-eed8-4032-bf37-6727ee32b256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:09 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4ec9d98c-d39d-4d43-bfd4-48a755aab494 tempest-VolumesAdminNegativeTest-1013364821 None] Created volume successfully. Apr 15 00:14:10 devstack sudo[84056]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 1073741824" returned: 0 in 0.700s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:10 devstack sudo[84062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 Apr 15 00:14:10 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING py.warnings [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 15 00:14:11 devstack cinder-volume[83219]: .first() Apr 15 00:14:11 devstack cinder-volume[83219]: Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Acquiring lock "cinder-f260dd7f-c6df-4326-8134-431f621d407d-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "cinder-f260dd7f-c6df-4326-8134-431f621d407d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:11 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355" returned: 0 in 0.874s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1e6d3a65-212d-4c22-96cd-aedc4aee25ba,created_at=2026-04-14T22:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388688012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1e6d3a65-212d-4c22-96cd-aedc4aee25ba,host='devstack@QuobyteHD#QuobyteHD',id=4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:08Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6859e279-6c43-4735-ac63-ec53078b8f26),volume_type_id=6859e279-6c43-4735-ac63-ec53078b8f26)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Creating volume 4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:11 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7669e1-afa8-48db-a795-0773b553967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6015de2-af40-4c9a-bb50-26d498654355', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:11 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 1073741824 Apr 15 00:14:11 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcd1181-95d1-4041-8a83-ddefd27de70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:11 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Volume volume-c6015de2-af40-4c9a-bb50-26d498654355 (c6015de2-af40-4c9a-bb50-26d498654355): created successfully Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcd1181-95d1-4041-8a83-ddefd27de70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Flow 'volume_create_manager' (f659253c-280f-431d-bef7-d36a4da57e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Acquiring lock "cinder-quobyte-f260dd7f-c6df-4326-8134-431f621d407d" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-78cc5efa-da84-496d-a488-4173ef9b6a5e tempest-GroupSnapshotsV319Test-425038103 None] Created volume successfully. Apr 15 00:14:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "cinder-quobyte-f260dd7f-c6df-4326-8134-431f621d407d" acquired by "delete_volume" :: waited 0.028s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:11 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnly3fic8/privsep.sock'] Apr 15 00:14:11 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnly3fic8/privsep.sock Apr 15 00:14:11 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 00:14:11 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 00:14:12 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 1073741824" returned: 0 in 0.634s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:12 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 Apr 15 00:14:12 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 00:14:12 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.181s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d0f6b8-d61f-47eb-82d4-6bf60b70c6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d268f2-8811-4a59-bbf6-07d5b311cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Volume volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 (4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4): created successfully Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d268f2-8811-4a59-bbf6-07d5b311cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (9d3a07cd-d0ad-41a1-87b8-95a2ceccf26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e6b25e99-fe37-4be8-a912-ad8dcf963195 tempest-GroupsTest-1037552755 None] Created volume successfully. Apr 15 00:14:12 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:12 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Spawned new privsep daemon via rootwrap Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Accepted privsep connection to /tmp/tmpnly3fic8/privsep.sock {{(pid=83219) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 00:14:12 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 00:14:12 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 00:14:12 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 00:14:12 devstack cinder-volume[83219]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84116 Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a49a881-68c4-432d-ba1c-04fe9211bd29]: (2,) {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:12 devstack cinder-volume[83219]: WARNING oslo_privsep.priv_context [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] privsep daemon already running Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3e1f2f-5fb5-4548-9bab-6ffc173264b2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a63854-7c5e-49e7-a162-b0b4eaa3ad1c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:12 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d Apr 15 00:14:12 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] GroupSnapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: creating. Apr 15 00:14:12 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 Apr 15 00:14:12 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Group snapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: creating. {{(pid=83219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:13 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d" returned: 0 in 0.720s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:13 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d Apr 15 00:14:13 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:13 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3" returned: 0 in 0.761s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.554s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Acquiring lock "cinder-quobyte-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" acquired by "delete_volume" :: waited 0.045s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Creating offline snapshot 1b74342a-d068-44e5-9f0c-2c840f312842 of volume c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29', 'name': 'volume-2be42595-16a7-45d2-aaf6-aed535bdeab3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ab58547-d036-4fa7-a16c-d926b48809b0', 'enforce_multipath': True} {{(pid=83219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3c6bb8-9c87-4f17-8739-e73de8147f2d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[084b20d3-af4d-4ec1-a8a9-3bc8db8dd0e0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-6454b3dc-0615-46f3-8ac9-20a9187b8932 req-fec2be42-2e78-433f-81e1-527c96b00e1f tempest-ServerBootFromVolumeStableRescueTest-920722975 None] attachment_update completed successfully. Apr 15 00:14:13 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 Apr 15 00:14:13 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:13 devstack sudo[84134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 Apr 15 00:14:13 devstack sudo[84134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:14 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f260dd7f-c6df-4326-8134-431f621d407d" returned: 0 in 0.747s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "cinder-quobyte-f260dd7f-c6df-4326-8134-431f621d407d" released by "delete_volume" :: held 2.717s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:14 devstack cinder-volume[83219]: WARNING cinder.quota [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:14 devstack cinder-volume[83219]: WARNING cinder.quota [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Created reservations ['a07e21e0-8e63-4a24-a8c8-93296e7bb1c1', '4db90ff4-ade5-4743-94c7-42c947ddf180', '33557247-5e34-445e-b399-3293aae02e79', '533c791e-b8f1-484b-8d31-46e3ddc49eff'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:14 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355" returned: 0 in 0.676s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:14 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 1G Apr 15 00:14:14 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:14 devstack sudo[84147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:14 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:14 devstack sudo[84134]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" returned: 0 in 0.964s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:14 devstack sudo[84149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4 Apr 15 00:14:14 devstack sudo[84149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:15 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.772s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:15 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Deleted volume successfully. Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7301d3c8-95e5-4518-b25f-b7642ec6b9da tempest-VolumesAdminNegativeTest-1013364821 None] Lock "cinder-f260dd7f-c6df-4326-8134-431f621d407d-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:15 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 1G" returned: 0 in 1.084s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6015de2-af40-4c9a-bb50-26d498654355 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:15 devstack sudo[84157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6015de2-af40-4c9a-bb50-26d498654355 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 Apr 15 00:14:15 devstack sudo[84157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:15 devstack sudo[84149]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" returned: 0 in 0.948s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-4eeca07b-b9b2-4e3d-8cf2-0a57e0b311d4" released by "delete_volume" :: held 1.969s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Created reservations ['32dd4bc0-cee3-4907-a8c3-81ef1e276276'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:15 devstack cinder-volume[83219]: WARNING cinder.quota [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-635982385 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-635982385, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:15 devstack cinder-volume[83219]: WARNING cinder.quota [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-635982385 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-635982385, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Created reservations ['57f10400-be3d-4c71-9096-2e4405c82f70', 'c43620d1-5d56-44a7-9335-8d170567331b', 'b8623642-fc4c-4dd9-8a33-3f0af43d7d42', '9e9142bf-ac4a-4373-9ede-2b8afa6fd246'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:15 devstack sudo[84161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:15 devstack sudo[84161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:16 devstack sudo[84157]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6015de2-af40-4c9a-bb50-26d498654355 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842" returned: 0 in 0.610s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:16 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:16 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 Apr 15 00:14:16 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:16 devstack sudo[84161]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.618s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-afd83fcb-f6fb-453a-b272-58584332294a tempest-GroupsTest-1037552755 None] Delete group completed successfully. Apr 15 00:14:16 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842" returned: 0 in 0.656s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:16 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info Apr 15 00:14:16 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Created reservations ['c1a922ef-f39f-45c8-afdb-996e74479a21'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:17 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:17 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:17 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info" returned: 0 in 0.440s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:17 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:17 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info Apr 15 00:14:17 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:17 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.437s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:17 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-75644b45-3b06-46a6-a5d5-3ade708bbc83 tempest-GroupsTest-1037552755 None] Delete group completed successfully. Apr 15 00:14:17 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.info" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.109s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:17 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-710ad042-2553-495e-9f77-07e91becfa4b tempest-GroupSnapshotsV319Test-425038103 None] group_snapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: created successfully Apr 15 00:14:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b0944507-cc08-4123-9e5d-a999e83e7bb4 tempest-GroupsTest-1037552755 None] Group tempest-GroupsTest-Group-565835613: creating Apr 15 00:14:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b0944507-cc08-4123-9e5d-a999e83e7bb4 tempest-GroupsTest-1037552755 None] Group tempest-GroupsTest-Group-565835613: created successfully Apr 15 00:14:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b0944507-cc08-4123-9e5d-a999e83e7bb4 tempest-GroupsTest-1037552755 None] Create group completed successfully. Apr 15 00:14:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] group_snapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: deleting Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] group_snapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: deleting {{(pid=83219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "cinder-quobyte-1b74342a-d068-44e5-9f0c-2c840f312842" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-1b74342a-d068-44e5-9f0c-2c840f312842" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Deleting offline snapshot 1b74342a-d068-44e5-9f0c-2c840f312842 of volume c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] snapshot_file for this snap is: volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad12030f-b8e1-4860-8bd2-67d6e4065188]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:19 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 Apr 15 00:14:19 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:19 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842" returned: 0 in 0.809s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6015de2-af40-4c9a-bb50-26d498654355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:14:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d8800-9f34-43f5-8cff-edd7adf8b9d7]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:19 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 Apr 15 00:14:19 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (44583ca3-1a25-418a-ba50-cdb295a94e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bff284-fe3e-4c9f-9659-e057bc4c73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bff284-fe3e-4c9f-9659-e057bc4c73f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706653944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=629a0d50-e576-4568-8327-23a1da833f3a,host='devstack@QuobyteHD#QuobyteHD',id=144008f2-609e-47d4-8a0b-3fdb47520b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:20Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f177a8-bf6d-487d-a7b4-4754e66a733d),volume_type_id=c9f177a8-bf6d-487d-a7b4-4754e66a733d)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc561cb2-1e95-4b8a-a7da-26f242323d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc561cb2-1e95-4b8a-a7da-26f242323d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cbf6c8-dfda-46b0-a1f0-c7757a3fdc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cbf6c8-dfda-46b0-a1f0-c7757a3fdc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144008f2-609e-47d4-8a0b-3fdb47520b04', 'volume_name': 'volume-144008f2-609e-47d4-8a0b-3fdb47520b04', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c570a2af-86ee-4a07-9f67-45fc78b7682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c570a2af-86ee-4a07-9f67-45fc78b7682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779662d4-5674-47e3-a1c5-d7408a2f6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:20 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Volume 144008f2-609e-47d4-8a0b-3fdb47520b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144008f2-609e-47d4-8a0b-3fdb47520b04', 'volume_size': 1} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=629a0d50-e576-4568-8327-23a1da833f3a,created_at=2026-04-14T22:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706653944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=629a0d50-e576-4568-8327-23a1da833f3a,host='devstack@QuobyteHD#QuobyteHD',id=144008f2-609e-47d4-8a0b-3fdb47520b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:20Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f177a8-bf6d-487d-a7b4-4754e66a733d),volume_type_id=c9f177a8-bf6d-487d-a7b4-4754e66a733d)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Creating volume 144008f2-609e-47d4-8a0b-3fdb47520b04 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:20 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:20 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 1073741824 Apr 15 00:14:20 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:20 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355" returned: 0 in 0.605s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:20 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 Apr 15 00:14:20 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:20 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 1073741824" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:20 devstack sudo[84639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 Apr 15 00:14:20 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:20 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:20 devstack sudo[84641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842 Apr 15 00:14:20 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:21 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779662d4-5674-47e3-a1c5-d7408a2f6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144008f2-609e-47d4-8a0b-3fdb47520b04', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee34996-c26d-4fdd-aa9a-3a8dc5dc0406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Volume volume-144008f2-609e-47d4-8a0b-3fdb47520b04 (144008f2-609e-47d4-8a0b-3fdb47520b04): created successfully Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee34996-c26d-4fdd-aa9a-3a8dc5dc0406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (44583ca3-1a25-418a-ba50-cdb295a94e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e0b6badc-f6aa-4110-b55e-fb12e49b659b tempest-GroupsTest-1037552755 None] Created volume successfully. Apr 15 00:14:21 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355.1b74342a-d068-44e5-9f0c-2c840f312842" returned: 0 in 0.494s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-1b74342a-d068-44e5-9f0c-2c840f312842" released by "_delete_snapshot" :: held 2.538s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" released by "delete_snapshot" :: held 2.549s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:21 devstack cinder-volume[83219]: WARNING cinder.quota [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-48709420 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-48709420, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:21 devstack cinder-volume[83219]: WARNING cinder.quota [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-48709420 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-48709420, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:21 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] Created reservations ['77a478d6-0f63-4bc9-9262-f2c7964c5877', '0afc3917-9990-4df6-a326-ae89a24b3f53', 'ad1d202d-1688-4bcb-aa7c-c25f68bfb565', '9f289272-1b0c-4100-ad2f-aa9a0d9ddde2'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e02cc963-6c4f-45b5-ac8d-07b5ffda0a03 tempest-GroupSnapshotsV319Test-425038103 None] group_snapshot 5bd7aa8f-2ec1-4ece-b7b5-ff1757616e00: deleted successfully Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" acquired by "delete_volume" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a7081-be9a-46b7-972f-455e0ddc4802]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:22 devstack sudo[84645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 Apr 15 00:14:22 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (e2d759bd-81f7-4e09-8a93-9c40dba2a233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437762ff-2e33-400f-9d05-12cb91abadbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437762ff-2e33-400f-9d05-12cb91abadbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324711837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=629a0d50-e576-4568-8327-23a1da833f3a,host='devstack@QuobyteHD#QuobyteHD',id=564bece8-e3f6-4578-9eeb-3d13549563a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:23Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f177a8-bf6d-487d-a7b4-4754e66a733d),volume_type_id=c9f177a8-bf6d-487d-a7b4-4754e66a733d)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9994ccc-1a9b-44f4-87b1-648563af841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9994ccc-1a9b-44f4-87b1-648563af841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5673c1c2-1aae-4de9-9cb7-5b242f95bbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5673c1c2-1aae-4de9-9cb7-5b242f95bbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564bece8-e3f6-4578-9eeb-3d13549563a0', 'volume_name': 'volume-564bece8-e3f6-4578-9eeb-3d13549563a0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8264e1-17b6-4187-9259-83e11135bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8264e1-17b6-4187-9259-83e11135bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7214e8-1974-4165-8161-73b1a7bf39d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:22 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Volume 564bece8-e3f6-4578-9eeb-3d13549563a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564bece8-e3f6-4578-9eeb-3d13549563a0', 'volume_size': 1} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=629a0d50-e576-4568-8327-23a1da833f3a,created_at=2026-04-14T22:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-324711837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=629a0d50-e576-4568-8327-23a1da833f3a,host='devstack@QuobyteHD#QuobyteHD',id=564bece8-e3f6-4578-9eeb-3d13549563a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eaba128e13d4d8781bd509f0607d63f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:23Z,use_quota=True,user_id='0212a79ce9684b4981174a04a1b6b9dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9f177a8-bf6d-487d-a7b4-4754e66a733d),volume_type_id=c9f177a8-bf6d-487d-a7b4-4754e66a733d)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Creating volume 564bece8-e3f6-4578-9eeb-3d13549563a0 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:22 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:22 devstack sudo[84648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 1073741824 Apr 15 00:14:22 devstack sudo[84648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:22 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355" returned: 0 in 0.634s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:22 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355 Apr 15 00:14:22 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:23 devstack sudo[84648]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 1073741824" returned: 0 in 0.638s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:23 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 Apr 15 00:14:23 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:23 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6015de2-af40-4c9a-bb50-26d498654355" returned: 0 in 0.654s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Lock "cinder-quobyte-c6015de2-af40-4c9a-bb50-26d498654355" released by "delete_volume" :: held 1.329s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Created reservations ['7e5e8ace-b392-4abc-92f0-0165df646311'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:23 devstack cinder-volume[83219]: WARNING cinder.quota [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-48709420 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-48709420, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Created reservations ['3003cfcc-64fc-43cb-bdb1-d8800de31eba', '10c00d6b-6f0a-4e8a-ab01-5163628077fc', '4c4653ea-8cac-42f3-bfe6-e0d525f49173', '953b704f-35e9-423a-92b3-e7fc507ce05d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:23 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:23 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:23 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0" returned: 0 in 0.466s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7214e8-1974-4165-8161-73b1a7bf39d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564bece8-e3f6-4578-9eeb-3d13549563a0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da565089-434a-455e-a6b3-012ee9a7994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Volume volume-564bece8-e3f6-4578-9eeb-3d13549563a0 (564bece8-e3f6-4578-9eeb-3d13549563a0): created successfully Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da565089-434a-455e-a6b3-012ee9a7994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Flow 'volume_create_manager' (e2d759bd-81f7-4e09-8a93-9c40dba2a233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:23 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-149e49d2-4bb5-4214-b094-7426a3b058b0 tempest-GroupsTest-1037552755 None] Created volume successfully. Apr 15 00:14:24 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.524s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:24 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:24 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e4edefb1-f358-40f3-8ddc-2297ad1af8a3 tempest-GroupSnapshotsV319Test-425038103 None] Delete group completed successfully. Apr 15 00:14:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-efaa32fb-42d0-4645-aeaf-2abdd3e60ffe tempest-GroupsTest-1037552755 None] Update group completed successfully. Apr 15 00:14:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4a1e12f3-e9fa-450c-b0ad-082a87b062f8 tempest-GroupsTest-1037552755 None] Update group completed successfully. Apr 15 00:14:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Acquiring lock "cinder-quobyte-144008f2-609e-47d4-8a0b-3fdb47520b04" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-144008f2-609e-47d4-8a0b-3fdb47520b04" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33f10e3-69ac-4fe6-9bc6-21e4b5d5f2b1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:28 devstack sudo[84695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 Apr 15 00:14:28 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0ba4dd57-de0d-4549-a627-ade9eb016699 tempest-GroupsV314Test-1984156362 None] Group tempest-GroupsV314Test-Group-797328332: creating Apr 15 00:14:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0ba4dd57-de0d-4549-a627-ade9eb016699 tempest-GroupsV314Test-1984156362 None] Group tempest-GroupsV314Test-Group-797328332: created successfully Apr 15 00:14:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0ba4dd57-de0d-4549-a627-ade9eb016699 tempest-GroupsV314Test-1984156362 None] Create group completed successfully. Apr 15 00:14:28 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04" returned: 0 in 0.725s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:28 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04 Apr 15 00:14:28 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:29 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-144008f2-609e-47d4-8a0b-3fdb47520b04" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-144008f2-609e-47d4-8a0b-3fdb47520b04" released by "delete_volume" :: held 1.273s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Acquiring lock "cinder-quobyte-564bece8-e3f6-4578-9eeb-3d13549563a0" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-564bece8-e3f6-4578-9eeb-3d13549563a0" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4126e8-9911-4ea1-a4ef-3b4c40485a83]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:29 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 Apr 15 00:14:29 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Flow 'volume_create_manager' (254092e6-d0d9-4ba0-b41f-848649ddceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724c3655-8162-4047-8973-90c094bf8f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724c3655-8162-4047-8973-90c094bf8f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140820104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e213a5b2-5269-49c1-b833-437ff7d84525,host='devstack@QuobyteHD#QuobyteHD',id=792efa65-d0df-45c2-9048-8e8b3801708b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59acad6eeb944fa8b57119047af94c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:30Z,use_quota=True,user_id='e16a6404976b46f195ac3eda194b639b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53dd0d00-716e-451c-982d-fdc20438c499),volume_type_id=53dd0d00-716e-451c-982d-fdc20438c499)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e69fc5-2645-42e3-8942-d8311bc1afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e69fc5-2645-42e3-8942-d8311bc1afc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfb58d2-8d1e-4c3c-b400-60e0f8a23b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcfb58d2-8d1e-4c3c-b400-60e0f8a23b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792efa65-d0df-45c2-9048-8e8b3801708b', 'volume_name': 'volume-792efa65-d0df-45c2-9048-8e8b3801708b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0a83ad-f4b0-4078-9261-b2d93fb8d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0a83ad-f4b0-4078-9261-b2d93fb8d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84811812-ddc0-49e1-af81-9d7fe1b47357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Volume 792efa65-d0df-45c2-9048-8e8b3801708b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792efa65-d0df-45c2-9048-8e8b3801708b', 'volume_size': 1} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e213a5b2-5269-49c1-b833-437ff7d84525,created_at=2026-04-14T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2140820104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e213a5b2-5269-49c1-b833-437ff7d84525,host='devstack@QuobyteHD#QuobyteHD',id=792efa65-d0df-45c2-9048-8e8b3801708b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59acad6eeb944fa8b57119047af94c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:30Z,use_quota=True,user_id='e16a6404976b46f195ac3eda194b639b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53dd0d00-716e-451c-982d-fdc20438c499),volume_type_id=53dd0d00-716e-451c-982d-fdc20438c499)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Creating volume 792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:29 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:29 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0" returned: 0 in 0.615s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:29 devstack sudo[84735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b 1073741824 Apr 15 00:14:29 devstack sudo[84735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:29 devstack sudo[84736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0 Apr 15 00:14:29 devstack sudo[84736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:30 devstack sudo[84736]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-564bece8-e3f6-4578-9eeb-3d13549563a0" returned: 0 in 0.499s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "cinder-quobyte-564bece8-e3f6-4578-9eeb-3d13549563a0" released by "delete_volume" :: held 1.136s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:30 devstack sudo[84735]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Created reservations ['98df2a92-4833-405c-828c-2a988e770563'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b 1073741824" returned: 0 in 0.589s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:30 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-276496389 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-276496389, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:30 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-276496389 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-276496389, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Created reservations ['13fd1667-f6cc-4f12-b9fd-d9f7512eeba8', 'c73e5483-6321-4f71-9c71-108e893e7afb', '6e196ee8-56bb-4d20-a86a-aaac81cdcb65', 'e48930b3-85b3-4b4a-adbb-945fd0279973'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:30 devstack sudo[84744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:30 devstack sudo[84744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Created reservations ['3eab17e0-f0ab-4995-8acf-db220f2bece2', 'df437d69-ee70-4613-8c4f-2d085033eabf', '4a5b7fe6-0cdd-4742-b73b-50b1d0620fd5', '2e1f5ef3-2467-40ec-88c7-b7e020196818'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:30 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:30 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:30 devstack sudo[84744]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.544s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84811812-ddc0-49e1-af81-9d7fe1b47357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792efa65-d0df-45c2-9048-8e8b3801708b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a877a-9651-4552-abfa-c98f945f950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:30 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Volume volume-792efa65-d0df-45c2-9048-8e8b3801708b (792efa65-d0df-45c2-9048-8e8b3801708b): created successfully Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9a877a-9651-4552-abfa-c98f945f950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Flow 'volume_create_manager' (254092e6-d0d9-4ba0-b41f-848649ddceb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:30 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6a4da582-6237-4671-9095-a563f66156fe tempest-GroupsV314Test-1984156362 None] Created volume successfully. Apr 15 00:14:31 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.621s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:31 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b327977f-2198-420d-bdfb-df450ad99439 tempest-GroupsTest-1037552755 None] Delete group completed successfully. Apr 15 00:14:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:32 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Cloning volume 792efa65-d0df-45c2-9048-8e8b3801708b to volume 2f59178f-7356-4174-8662-ff2aa510cb1e Apr 15 00:14:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Creating offline snapshot 6b53137e-f6ab-4aae-9355-a0c6ada89022 of volume 792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:14:32 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[349feefc-1e97-415a-be8b-564d08410e56]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:32 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:32 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:33 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.960s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:33 devstack sudo[84792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 1G Apr 15 00:14:33 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:34 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 1G" returned: 0 in 0.712s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-792efa65-d0df-45c2-9048-8e8b3801708b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:34 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-792efa65-d0df-45c2-9048-8e8b3801708b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:34 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:35 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-792efa65-d0df-45c2-9048-8e8b3801708b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.656s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:35 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:14:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:35 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:35 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:35 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.616s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:35 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info Apr 15 00:14:35 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:36 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info" returned: 0 in 0.509s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:36 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:14:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:36 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info Apr 15 00:14:36 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:37 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.info" returned: 0 in 0.738s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Acquiring lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] snapshot: 6b53137e-f6ab-4aae-9355-a0c6ada89022, volume: 2f59178f-7356-4174-8662-ff2aa510cb1e, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d60b3-058b-48a4-9122-b8962b5234be]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:37 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:37 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:37 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.706s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-792efa65-d0df-45c2-9048-8e8b3801708b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce745bd-9803-472b-a83f-1d195b3e92af]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:37 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:37 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:38 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.723s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:38 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:14:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:38 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e Apr 15 00:14:38 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:41 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e" returned: 0 in 3.213s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:41 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8da1961-3928-46d7-83d6-bbcf56f9fac6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:41 devstack sudo[84962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:41 devstack sudo[84962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:42 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:42 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Flow 'volume_create_manager' (920e9f6d-9888-4502-a3f8-e1b016c4ee45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e98739-ad01-41cb-ac41-9a7b8764da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e98739-ad01-41cb-ac41-9a7b8764da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038758146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a6d6e6-71b2-419d-8f90-e4c75461470e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a51de2e42ae419386c5639fd3e250d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:42Z,use_quota=True,user_id='ba69d7de6d4444c38ced69b13cedbd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68140173-6b05-41ad-a576-eff77e86a2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68140173-6b05-41ad-a576-eff77e86a2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751d820a-a295-4597-a197-127f0d3976a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751d820a-a295-4597-a197-127f0d3976a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a6d6e6-71b2-419d-8f90-e4c75461470e', 'volume_name': 'volume-39a6d6e6-71b2-419d-8f90-e4c75461470e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648a54af-94a6-4628-b890-39bcae193816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (648a54af-94a6-4628-b890-39bcae193816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4dec87-15b5-4601-af5c-022a5f4e4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:42 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Volume 39a6d6e6-71b2-419d-8f90-e4c75461470e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a6d6e6-71b2-419d-8f90-e4c75461470e', 'volume_size': 1} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:42 devstack sudo[84962]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 1.014s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b, size 1024.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:14:42 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Converted 1024.00 MB image at 318.61 MB/s Apr 15 00:14:42 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:42 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e Apr 15 00:14:42 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:42 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.720s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:43 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e" returned: 0 in 0.542s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" released by "_copy_volume_from_snapshot" :: held 6.249s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Acquiring lock "cinder-quobyte-6b53137e-f6ab-4aae-9355-a0c6ada89022" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-6b53137e-f6ab-4aae-9355-a0c6ada89022" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Deleting offline snapshot 6b53137e-f6ab-4aae-9355-a0c6ada89022 of volume 792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] snapshot_file for this snap is: volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2db16-8de1-452e-a990-f272da0c0cf5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:43 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:43 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:43 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-792efa65-d0df-45c2-9048-8e8b3801708b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefc594f-f470-4dd7-bc27-1533c8812f09]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:43 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:43 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:44 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:44 devstack sudo[84991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:44 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:44 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.530s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:44 devstack sudo[84997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022 Apr 15 00:14:44 devstack sudo[84997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:45 devstack sudo[84997]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b.6b53137e-f6ab-4aae-9355-a0c6ada89022" returned: 0 in 0.436s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-6b53137e-f6ab-4aae-9355-a0c6ada89022" released by "_delete_snapshot" :: held 2.075s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.643s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.773s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038758146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a6d6e6-71b2-419d-8f90-e4c75461470e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a51de2e42ae419386c5639fd3e250d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:42Z,use_quota=True,user_id='ba69d7de6d4444c38ced69b13cedbd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Creating volume 39a6d6e6-71b2-419d-8f90-e4c75461470e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:45 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:45 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e 1073741824 Apr 15 00:14:45 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:45 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-677e0cc9-ebe7-45a1-bbc7-02df5e819066 tempest-GroupsV314Test-1984156362 None] Create group from source-group-e213a5b2-5269-49c1-b833-437ff7d84525 completed successfully. Apr 15 00:14:45 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e 1073741824" returned: 0 in 0.554s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:46 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e Apr 15 00:14:46 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:46 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e" returned: 0 in 0.523s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4dec87-15b5-4601-af5c-022a5f4e4928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a6d6e6-71b2-419d-8f90-e4c75461470e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e36e759-a8fd-4438-8bec-9511f42fd7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:46 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Volume volume-39a6d6e6-71b2-419d-8f90-e4c75461470e (39a6d6e6-71b2-419d-8f90-e4c75461470e): created successfully Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e36e759-a8fd-4438-8bec-9511f42fd7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Flow 'volume_create_manager' (920e9f6d-9888-4502-a3f8-e1b016c4ee45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-391b4b95-d612-48b3-bda3-5cdac78afa24 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Created volume successfully. Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Acquiring lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[018df12b-ffea-4ff2-96cd-8cbbbf6382a9]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:46 devstack sudo[85009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e Apr 15 00:14:46 devstack sudo[85009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:47 devstack sudo[85009]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e" returned: 0 in 0.672s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:47 devstack sudo[85014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e Apr 15 00:14:47 devstack sudo[85014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Acquiring lock "cinder-39a6d6e6-71b2-419d-8f90-e4c75461470e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "cinder-39a6d6e6-71b2-419d-8f90-e4c75461470e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Acquiring lock "cinder-quobyte-39a6d6e6-71b2-419d-8f90-e4c75461470e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "cinder-quobyte-39a6d6e6-71b2-419d-8f90-e4c75461470e" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1883090c-7d40-40e5-8ca6-99d6c8355ad0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:47 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e Apr 15 00:14:47 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:48 devstack sudo[85014]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2f59178f-7356-4174-8662-ff2aa510cb1e" returned: 0 in 0.582s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-2f59178f-7356-4174-8662-ff2aa510cb1e" released by "delete_volume" :: held 1.303s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Created reservations ['5aa0e3b4-ddb5-4915-b7ee-f403401ffe03'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:48 devstack cinder-volume[83219]: WARNING cinder.quota [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-619751299 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-619751299, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:48 devstack cinder-volume[83219]: WARNING cinder.quota [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-619751299 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-619751299, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Created reservations ['c91ef71f-df79-4ff8-aa29-ee29ea8c8457', '8d7365f0-dce1-4b77-b3d7-06cacb932c3b', 'dc10946a-2100-4453-a81e-9d88ff7cf049', 'e14a190e-1b18-4427-83d6-517c627184b3'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:48 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:48 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:48 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e" returned: 0 in 0.699s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:48 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e Apr 15 00:14:48 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:48 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.547s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0254c61c-e45b-4ccd-994f-4b53f587e8d6 tempest-GroupsV314Test-1984156362 None] Delete group completed successfully. Apr 15 00:14:48 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-39a6d6e6-71b2-419d-8f90-e4c75461470e" returned: 0 in 0.608s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "cinder-quobyte-39a6d6e6-71b2-419d-8f90-e4c75461470e" released by "delete_volume" :: held 1.346s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Created reservations ['7281186f-dd12-460a-ad9b-e8874d4b1006', 'd328c950-409a-4ce2-9b74-0d6d498606b9', 'd6b2c06d-d23e-45f2-a9fc-68eb55a23fc5', '09eb8c26-88a9-42ee-a63d-fa5589b1fe15'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:49 devstack sudo[85049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:49 devstack sudo[85049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Acquiring lock "cinder-quobyte-792efa65-d0df-45c2-9048-8e8b3801708b" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-792efa65-d0df-45c2-9048-8e8b3801708b" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13addb-a48e-4063-91d8-78c7d779c2e1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:49 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:49 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:49 devstack sudo[85049]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Deleted volume successfully. Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0c46969b-97b8-43c7-b5aa-7dc0bfda3a98 tempest-VolumeQuotasNegativeTestJSON-777200819 None] Lock "cinder-39a6d6e6-71b2-419d-8f90-e4c75461470e-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:49 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:49 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b Apr 15 00:14:49 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:50 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-792efa65-d0df-45c2-9048-8e8b3801708b" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Lock "cinder-quobyte-792efa65-d0df-45c2-9048-8e8b3801708b" released by "delete_volume" :: held 1.020s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Created reservations ['d74c2ac6-188f-46f9-bc92-d27e9e9706ae'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Created reservations ['5c1acaa1-60df-47e3-97a9-4d6ac9f95e28', 'd7d066ad-0489-4797-bed3-d2a8b412e5d6', '90bd3131-64da-451b-a473-2657f9d9b1ca', 'f670a9b8-c9d5-41cc-868d-92d05b57a71d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:50 devstack sudo[85062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:50 devstack sudo[85062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:50 devstack sudo[85062]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:50 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:50 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-34044c43-63a4-40be-9865-d7587f885e61 tempest-GroupsV314Test-1984156362 None] Delete group completed successfully. Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Flow 'volume_create_manager' (c22d24ec-4ddb-4ad3-931b-93c976345325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea4f08-5b51-4f30-ac50-c3515750fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eea4f08-5b51-4f30-ac50-c3515750fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1118322737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd4bd2f253b4597826d7cd298f114ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:54Z,use_quota=True,user_id='64626443245747988558331f4af68f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5d2d32-c7aa-42d5-aa01-2b181d6b4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5d2d32-c7aa-42d5-aa01-2b181d6b4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196a472-1374-4f47-bef3-bdfd0b59859c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196a472-1374-4f47-bef3-bdfd0b59859c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd', 'volume_name': 'volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88390d59-bab6-4337-a812-f0a8ef10d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88390d59-bab6-4337-a812-f0a8ef10d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cbf999-22fd-44eb-aacf-1f9537a21c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:54 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Volume 7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd', 'volume_size': 1} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1118322737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd4bd2f253b4597826d7cd298f114ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:14:54Z,use_quota=True,user_id='64626443245747988558331f4af68f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Creating volume 7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:14:54 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:14:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:54 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd 1073741824 Apr 15 00:14:54 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:55 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd 1073741824" returned: 0 in 1.138s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:55 devstack sudo[85118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd Apr 15 00:14:55 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:56 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" returned: 0 in 0.709s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5cbf999-22fd-44eb-aacf-1f9537a21c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a63b6b0-76d5-4750-9489-2a953012c5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:14:56 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Volume volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd (7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd): created successfully Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a63b6b0-76d5-4750-9489-2a953012c5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:14:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Flow 'volume_create_manager' (c22d24ec-4ddb-4ad3-931b-93c976345325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:14:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-08bd05fe-e7bc-4420-8ec3-6f7a0c53270e tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Created volume successfully. Apr 15 00:14:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-73b5b8a8-9cb8-40b3-966b-8a05935b8ee1 tempest-GroupsV320Test-671808642 None] Group tempest-GroupsV320Test-Group-1922082994: creating Apr 15 00:14:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-73b5b8a8-9cb8-40b3-966b-8a05935b8ee1 tempest-GroupsV320Test-671808642 None] Group tempest-GroupsV320Test-Group-1922082994: created successfully Apr 15 00:14:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-73b5b8a8-9cb8-40b3-966b-8a05935b8ee1 tempest-GroupsV320Test-671808642 None] Create group completed successfully. Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Creating offline snapshot 73eedb9d-21b3-4e3c-8ecb-445aaeedb013 of volume 7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1a9d5-a101-4389-9042-dcb9240bd1a1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:57 devstack sudo[85130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd Apr 15 00:14:57 devstack sudo[85130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=133,cinder:UPDATE=121,cinder:INSERT=26,cinder:DELETE=4 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Created reservations ['c667525c-f020-48c7-b05f-d9fbf116128e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:14:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:57 devstack sudo[85132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:14:57 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:58 devstack sudo[85130]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" returned: 0 in 0.625s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:58 devstack sudo[85138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 1G Apr 15 00:14:58 devstack sudo[85138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:58 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.514s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:14:58 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-71a6edd0-a0bd-4fd7-9b05-e7595752acf2 tempest-GroupsV320Test-671808642 None] Delete group completed successfully. Apr 15 00:14:58 devstack sudo[85138]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 1G" returned: 0 in 0.610s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:58 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 Apr 15 00:14:58 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:59 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:59 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 is being set with open permissions: ugo+rw Apr 15 00:14:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:59 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 Apr 15 00:14:59 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:14:59 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Apr 15 00:14:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:14:59 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=141,cinder:SELECT=125,cinder:DELETE=7,cinder:INSERT=29 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:14:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:14:59 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info Apr 15 00:14:59 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:00 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info" returned: 0 in 0.970s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:00 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info is being set with open permissions: ugo+rw Apr 15 00:15:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:00 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info Apr 15 00:15:00 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:01 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.info" returned: 0 in 0.646s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.848s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8de850ec-bc4e-4e84-b738-91a3316f88e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Create snapshot completed successfully Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "cinder-73eedb9d-21b3-4e3c-8ecb-445aaeedb013-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-73eedb9d-21b3-4e3c-8ecb-445aaeedb013-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "cinder-quobyte-73eedb9d-21b3-4e3c-8ecb-445aaeedb013" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-73eedb9d-21b3-4e3c-8ecb-445aaeedb013" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Deleting offline snapshot 73eedb9d-21b3-4e3c-8ecb-445aaeedb013 of volume 7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] snapshot_file for this snap is: volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b2e12-b0c6-4704-b997-f33bf588f583]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:02 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 Apr 15 00:15:02 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Flow 'volume_create_manager' (a443059c-f021-4516-afa4-f025b3813aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8682f160-4b0f-41c3-8033-cf3f967715a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8682f160-4b0f-41c3-8033-cf3f967715a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-154071530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821780c7-2319-43b2-974a-254d852bb1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5017f2379244474a272b9edd2e92b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:04Z,use_quota=True,user_id='c97e0976bda6431a9e4a52d39b659511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf57c0af-e974-4a79-b329-0d3246f7e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf57c0af-e974-4a79-b329-0d3246f7e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972576f7-7945-433e-9221-b46ef0e5d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972576f7-7945-433e-9221-b46ef0e5d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821780c7-2319-43b2-974a-254d852bb1d8', 'volume_name': 'volume-821780c7-2319-43b2-974a-254d852bb1d8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c0e219-3cc4-4ae2-89cf-892ef9f83a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c0e219-3cc4-4ae2-89cf-892ef9f83a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b784962-c76a-466c-9baa-489ac153ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:03 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Volume 821780c7-2319-43b2-974a-254d852bb1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821780c7-2319-43b2-974a-254d852bb1d8', 'volume_size': 1} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-154071530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821780c7-2319-43b2-974a-254d852bb1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5017f2379244474a272b9edd2e92b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:04Z,use_quota=True,user_id='c97e0976bda6431a9e4a52d39b659511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Creating volume 821780c7-2319-43b2-974a-254d852bb1d8 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:03 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:03 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 1073741824 Apr 15 00:15:03 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:04 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013" returned: 0 in 1.555s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8c8c7-722d-43ed-b117-55f666885c31]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:04 devstack sudo[85219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd Apr 15 00:15:04 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:04 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 1073741824" returned: 0 in 0.981s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:04 devstack sudo[85228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 Apr 15 00:15:04 devstack sudo[85228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:05 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" returned: 0 in 0.891s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:05 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 Apr 15 00:15:05 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:06 devstack sudo[85228]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8" returned: 0 in 1.152s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b784962-c76a-466c-9baa-489ac153ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821780c7-2319-43b2-974a-254d852bb1d8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2d7cc5-a4b9-4102-8604-bbea0539dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Volume volume-821780c7-2319-43b2-974a-254d852bb1d8 (821780c7-2319-43b2-974a-254d852bb1d8): created successfully Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2d7cc5-a4b9-4102-8604-bbea0539dea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Flow 'volume_create_manager' (a443059c-f021-4516-afa4-f025b3813aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-736fe417-68b3-4e08-9712-a3636059b0d4 tempest-DeleteServersTestJSON-1922471875 None] Created volume successfully. Apr 15 00:15:06 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013" returned: 0 in 1.071s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:06 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013 Apr 15 00:15:06 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:06 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd.73eedb9d-21b3-4e3c-8ecb-445aaeedb013" returned: 0 in 0.751s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-73eedb9d-21b3-4e3c-8ecb-445aaeedb013" released by "_delete_snapshot" :: held 4.507s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" released by "delete_snapshot" :: held 4.531s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:07 devstack cinder-volume[83219]: WARNING cinder.quota [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:15:07 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Created reservations ['ae6cabef-9edd-4929-9102-dde43c84f8d0', 'a35dddd9-9138-4ac1-9526-65205d57fc5a', '6c037505-8217-446b-8861-bea1b257657f', 'a8729262-7d2a-4934-8045-ce8974398b08'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Delete snapshot completed successfully. Apr 15 00:15:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f9d48969-2860-4bb9-a22c-67438112984c tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-73eedb9d-21b3-4e3c-8ecb-445aaeedb013-delete_snapshot" released by "delete_snapshot" :: held 4.787s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "cinder-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" acquired by "delete_volume" :: waited 0.046s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc9cbd-dbf6-4e61-a9c8-b99a79f9f6c2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:08 devstack sudo[85251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd Apr 15 00:15:08 devstack sudo[85251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:09 devstack sudo[85251]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" returned: 0 in 0.658s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:09 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd Apr 15 00:15:09 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:09 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" returned: 0 in 0.729s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-quobyte-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd" released by "delete_volume" :: held 1.543s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Created reservations ['205d803a-7f3b-48d9-a560-c4c7800bf93a', 'ba10dbfb-aa8f-4b3d-93ef-dacd3e07a5f8', 'cd0cd8a8-524c-4c78-8517-080933d8b4b9', 'd899f996-1cc1-4d62-9d0f-ffee36b0ba64'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:09 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:09 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:10 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Deleted volume successfully. Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b60bc08f-e48e-41bc-a177-38523702d590 tempest-VolumeSnapshotQuotasNegativeTestJSON-1820559331 None] Lock "cinder-7c1b14c7-1a5b-4d78-9a82-2b048bfd69fd-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[53646678-ba20-40f0-a595-1eb3a3f1a7ea]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:11 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 Apr 15 00:15:11 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:11 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8" returned: 0 in 0.981s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.034s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29', 'name': 'volume-821780c7-2319-43b2-974a-254d852bb1d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ee65664-ad8e-4bf4-a030-6897c74ecc8a', 'enforce_multipath': True} {{(pid=83219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 00:15:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-fc92cf9e-1a37-4750-a16e-43a8d3c1761c req-13389151-9ccb-4501-9a6b-9470b9a503a7 tempest-DeleteServersTestJSON-1922471875 None] attachment_update completed successfully. Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Flow 'volume_create_manager' (ab3ecaac-1afd-481d-b6eb-e2700045c5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ae14a5-410b-412a-b282-23d6b4c64808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ae14a5-410b-412a-b282-23d6b4c64808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c45789b-8bd1-41f6-b105-a499764b528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752149c55bdf4afe896a2ac740056889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:14Z,use_quota=True,user_id='ea3004c9ade9487e94079dd543daceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7796bc2a-6b6d-4a00-ab9d-4c8b82d4a130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7796bc2a-6b6d-4a00-ab9d-4c8b82d4a130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb56844-b642-45e7-ac4c-93ef43505e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:14 devstack cinder-volume[83219]: DEBUG cinder.image.glance [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Creating Keystone auth plugin from conf {{(pid=83219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb56844-b642-45e7-ac4c-93ef43505e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c45789b-8bd1-41f6-b105-a499764b528f', 'volume_name': 'volume-7c45789b-8bd1-41f6-b105-a499764b528f', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d63ad9a-781c-4b2b-9f50-42bf9475ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d63ad9a-781c-4b2b-9f50-42bf9475ab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c605cc61-3265-4d43-a877-0026905f9ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:15 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume 7c45789b-8bd1-41f6-b105-a499764b528f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c45789b-8bd1-41f6-b105-a499764b528f', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Trying to clone 7c45789b-8bd1-41f6-b105-a499764b528f from image bb201dba-017f-4c90-9496-4d9f4a01c76f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]). {{(pid=83219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 00:15:15 devstack cinder-volume[83219]: INFO cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Image download 20.69 MB at 20.69 MB/s Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a94c7-62e0-48e8-a3cf-21686121188d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:15 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD Apr 15 00:15:15 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:16 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:16 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f is fetched for user ea3004c9ade9487e94079dd543daceae. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 00:15:16 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95709b1-0adf-4e2f-94a8-ebe3bd3682aa]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:16 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD Apr 15 00:15:16 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:17 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD" returned: 0 in 1.371s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:14Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c45789b-8bd1-41f6-b105-a499764b528f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752149c55bdf4afe896a2ac740056889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:14Z,use_quota=True,user_id='ea3004c9ade9487e94079dd543daceae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Creating volume 7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:17 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:17 devstack sudo[85375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1073741824 Apr 15 00:15:17 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:18 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1073741824" returned: 0 in 1.151s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:18 devstack sudo[85430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:18 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:19 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 1.095s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Attempting download of bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume 7c45789b-8bd1-41f6-b105-a499764b528f. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[482dfb02-b4f4-4b81-ad70-b534802b0d62]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:20 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9 Apr 15 00:15:20 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:20 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9" returned: 0 in 0.744s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:20 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-73d8e92f-c9c7-434d-8bda-48a05914fef9 req-c213b9c2-9256-43a1-9eeb-9ab7e88439ac tempest-DeleteServersTestJSON-1922471875 None] Terminate volume connection completed successfully. Apr 15 00:15:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-73d8e92f-c9c7-434d-8bda-48a05914fef9 req-c213b9c2-9256-43a1-9eeb-9ab7e88439ac tempest-DeleteServersTestJSON-1922471875 None] Deleting attachment 1ee65664-ad8e-4bf4-a030-6897c74ecc8a. {{(pid=83219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 00:15:20 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9 Apr 15 00:15:20 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:21 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9" returned: 1 in 0.627s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rtmrjpf9' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb15e9-e98b-4fdf-83d0-c32958366097]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:21 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD Apr 15 00:15:21 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:21 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] bb201dba-017f-4c90-9496-4d9f4a01c76f was qcow2, converting to raw {{(pid=83219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 00:15:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:22 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:22 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:23 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 1.246s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_q4javgqldevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:15:23 devstack cinder-volume[83219]: INFO cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Converted 112.00 MB image at 89.82 MB/s Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:23 devstack sudo[85458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1G Apr 15 00:15:23 devstack sudo[85458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:23 devstack sudo[85458]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f 1G" returned: 0 in 0.523s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4496224-99ae-420c-95dd-07a631ac726f]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:23 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:23 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "cinder-821780c7-2319-43b2-974a-254d852bb1d8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "cinder-821780c7-2319-43b2-974a-254d852bb1d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "cinder-quobyte-821780c7-2319-43b2-974a-254d852bb1d8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "cinder-quobyte-821780c7-2319-43b2-974a-254d852bb1d8" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde0f10-4ab5-4439-8623-5974d11c940a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:24 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 Apr 15 00:15:24 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:25 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 1.368s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:25 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:25 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:25 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8" returned: 0 in 1.220s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:25 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8 Apr 15 00:15:25 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:26 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 1 in 1.177s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Downloaded image bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume 7c45789b-8bd1-41f6-b105-a499764b528f successfully. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f for user ea3004c9ade9487e94079dd543daceae is deleted. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Marking volume 7c45789b-8bd1-41f6-b105-a499764b528f as bootable. {{(pid=83219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Copying metadata from image bb201dba-017f-4c90-9496-4d9f4a01c76f to 7c45789b-8bd1-41f6-b105-a499764b528f. {{(pid=83219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Creating volume glance metadata for volume 7c45789b-8bd1-41f6-b105-a499764b528f backed by image bb201dba-017f-4c90-9496-4d9f4a01c76f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c605cc61-3265-4d43-a877-0026905f9ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c45789b-8bd1-41f6-b105-a499764b528f', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aadf413-faa6-47c8-b5eb-2c4a7c6bd874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:26 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Volume volume-7c45789b-8bd1-41f6-b105-a499764b528f (7c45789b-8bd1-41f6-b105-a499764b528f): created successfully Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aadf413-faa6-47c8-b5eb-2c4a7c6bd874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Flow 'volume_create_manager' (ab3ecaac-1afd-481d-b6eb-e2700045c5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-d8cdf0bc-44df-46b1-b211-fc444a0dad3d tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Created volume successfully. Apr 15 00:15:26 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-821780c7-2319-43b2-974a-254d852bb1d8" returned: 0 in 1.033s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "cinder-quobyte-821780c7-2319-43b2-974a-254d852bb1d8" released by "delete_volume" :: held 2.303s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Created reservations ['25d6c9f1-783f-4097-98f2-e90f42da80d8', '35f0677f-dbed-4c5d-982a-268a1c64b65e', '9a93190e-7442-4db9-ba33-723fd10ce0dc', '88e03d2b-9326-4cf9-bc6f-5e923ad9b2dd'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:27 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:27 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4aec09-70a0-476b-8ab5-a2c042ef9043]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:27 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:27 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:27 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.706s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:27 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Deleted volume successfully. Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7dd177d8-b9a0-4672-851c-321f2db77bef tempest-DeleteServersTestJSON-1922471875 None] Lock "cinder-821780c7-2319-43b2-974a-254d852bb1d8-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:27 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:27 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:15:27 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:28 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 1 in 0.502s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:15:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.053s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29', 'name': 'volume-7c45789b-8bd1-41f6-b105-a499764b528f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90842b22-a340-4cc9-8930-1c96757433b1', 'enforce_multipath': True} {{(pid=83219) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 00:15:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-c4196421-f890-47f5-916a-f1b7fc572512 req-ba5ebf3e-d2ad-4a9b-915c-b90b07bc52ec tempest-ServerBootFromVolumeStableRescueTest-920722975 None] attachment_update completed successfully. Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Flow 'volume_create_manager' (2505f4be-58ca-45d9-b172-5de7d9b9baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c660a6-5f6b-4936-a1bb-1f6fe843c3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c660a6-5f6b-4936-a1bb-1f6fe843c3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1433769140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6b8374-9980-471f-973a-cddc0228018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d977fb0a084decb21c39ce1e8fffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:35Z,use_quota=True,user_id='48dc66dfc3324bcfa260f0731eb19ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c61119-e40a-4bcb-86d4-36642781ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c61119-e40a-4bcb-86d4-36642781ae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73dab3c-7ee7-4086-9118-ee1c1bafa9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73dab3c-7ee7-4086-9118-ee1c1bafa9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6b8374-9980-471f-973a-cddc0228018c', 'volume_name': 'volume-3c6b8374-9980-471f-973a-cddc0228018c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc94e69-a6b6-46c8-99a9-2be12ec57867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc94e69-a6b6-46c8-99a9-2be12ec57867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105f4fb8-a932-4832-9883-112c75263c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:34 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Volume 3c6b8374-9980-471f-973a-cddc0228018c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6b8374-9980-471f-973a-cddc0228018c', 'volume_size': 1} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1433769140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6b8374-9980-471f-973a-cddc0228018c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50d977fb0a084decb21c39ce1e8fffcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:35Z,use_quota=True,user_id='48dc66dfc3324bcfa260f0731eb19ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Creating volume 3c6b8374-9980-471f-973a-cddc0228018c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:34 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:35 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c 1073741824 Apr 15 00:15:35 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:35 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c 1073741824" returned: 0 in 0.768s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:35 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c Apr 15 00:15:35 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:36 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c" returned: 0 in 0.550s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105f4fb8-a932-4832-9883-112c75263c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6b8374-9980-471f-973a-cddc0228018c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e491e1c-a559-4cc6-90ec-78a43fbba3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:36 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Volume volume-3c6b8374-9980-471f-973a-cddc0228018c (3c6b8374-9980-471f-973a-cddc0228018c): created successfully Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e491e1c-a559-4cc6-90ec-78a43fbba3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Flow 'volume_create_manager' (2505f4be-58ca-45d9-b172-5de7d9b9baaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e1ccfeb9-509c-4a14-abc4-5b9696a02d2a tempest-AbsoluteLimitsTests-584418637 None] Created volume successfully. Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Acquiring lock "cinder-3c6b8374-9980-471f-973a-cddc0228018c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "cinder-3c6b8374-9980-471f-973a-cddc0228018c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Acquiring lock "cinder-quobyte-3c6b8374-9980-471f-973a-cddc0228018c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "cinder-quobyte-3c6b8374-9980-471f-973a-cddc0228018c" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ab506-602a-4df4-afbb-de4ce6106c9e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:37 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c Apr 15 00:15:37 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:38 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c" returned: 0 in 1.110s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:38 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c Apr 15 00:15:38 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:38 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c6b8374-9980-471f-973a-cddc0228018c" returned: 0 in 0.575s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "cinder-quobyte-3c6b8374-9980-471f-973a-cddc0228018c" released by "delete_volume" :: held 1.715s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:38 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Created reservations ['ead816c3-9faa-4f8a-980e-340330cb1b28', 'b514536e-0a86-4b1b-8297-8b9d4d07194c', '8d3787c8-ab9e-4a32-95d6-aedae9bb2c28', '0b0bddea-6f3f-49e4-b1cc-b9123c067515'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:39 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:39 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:39 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.657s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:39 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Deleted volume successfully. Apr 15 00:15:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-de42f821-398f-4036-8597-f771e9ceca65 tempest-AbsoluteLimitsTests-584418637 None] Lock "cinder-3c6b8374-9980-471f-973a-cddc0228018c-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:42 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:42 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:43 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.609s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:43 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (72bc0632-5cbc-493a-92c4-8ed8bf7cad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10811126-fa1a-4eba-9542-079623dd6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10811126-fa1a-4eba-9542-079623dd6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2039414674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656f2279-7c8f-482b-ac1c-f20213325831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:46Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b8d988-563d-42f1-b4d1-4566e3d3d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b8d988-563d-42f1-b4d1-4566e3d3d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408b61ff-a5f7-4c84-8646-96438bbb007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408b61ff-a5f7-4c84-8646-96438bbb007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656f2279-7c8f-482b-ac1c-f20213325831', 'volume_name': 'volume-656f2279-7c8f-482b-ac1c-f20213325831', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416381e8-76e0-4a99-a297-76a6ba30a23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416381e8-76e0-4a99-a297-76a6ba30a23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a552f-44ce-4676-95ed-1f56fd1d0e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:45 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Volume 656f2279-7c8f-482b-ac1c-f20213325831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656f2279-7c8f-482b-ac1c-f20213325831', 'volume_size': 1} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2039414674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656f2279-7c8f-482b-ac1c-f20213325831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:46Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Creating volume 656f2279-7c8f-482b-ac1c-f20213325831 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:45 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:45 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 1073741824 Apr 15 00:15:45 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:46 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 1073741824" returned: 0 in 0.804s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:46 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 Apr 15 00:15:46 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Flow 'volume_create_manager' (900c11d9-a5cb-4a25-890f-924bf8eb975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b221fe10-ab13-465a-990f-91bff4bbfd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b221fe10-ab13-465a-990f-91bff4bbfd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-577055875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2945dc0033da4ec9bf93ff8fcca14276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:47Z,use_quota=True,user_id='94c36df2a1a643e4a7b603c57e32e1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a85168d-49e3-4a92-9da3-f6c7d7574590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a85168d-49e3-4a92-9da3-f6c7d7574590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21064ce3-4102-4330-8a54-561820ce61bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21064ce3-4102-4330-8a54-561820ce61bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c', 'volume_name': 'volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026cb4bf-16c0-4972-9db7-d3979b2fe590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026cb4bf-16c0-4972-9db7-d3979b2fe590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17e5337-25de-4782-a1aa-10f75e24e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Volume d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c', 'volume_size': 1} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:47 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831" returned: 0 in 0.423s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-577055875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2945dc0033da4ec9bf93ff8fcca14276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:47Z,use_quota=True,user_id='94c36df2a1a643e4a7b603c57e32e1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Creating volume d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:47 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a552f-44ce-4676-95ed-1f56fd1d0e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656f2279-7c8f-482b-ac1c-f20213325831', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5580205-9c6f-4dcb-9245-30f76f2868b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:47 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c 1073741824 Apr 15 00:15:47 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:47 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Volume volume-656f2279-7c8f-482b-ac1c-f20213325831 (656f2279-7c8f-482b-ac1c-f20213325831): created successfully Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5580205-9c6f-4dcb-9245-30f76f2868b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (72bc0632-5cbc-493a-92c4-8ed8bf7cad7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e076cb80-5cbc-4502-8988-238818d03c58 tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:15:47 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c 1073741824" returned: 0 in 0.753s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-22038489-f673-4289-91cf-517da81291eb tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831" by "attach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:48 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c Apr 15 00:15:48 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-22038489-f673-4289-91cf-517da81291eb tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831" acquired by "attach_volume" :: waited 0.042s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-22038489-f673-4289-91cf-517da81291eb tempest-VolumesActionsTest-195479120 None] Attaching volume 656f2279-7c8f-482b-ac1c-f20213325831 to instance 6e83bdc7-d064-40a1-b28d-946150e40984 at mountpoint /dev/vdb on host None. Apr 15 00:15:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-22038489-f673-4289-91cf-517da81291eb tempest-VolumesActionsTest-195479120 None] Attach volume completed successfully. Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-22038489-f673-4289-91cf-517da81291eb tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831" released by "attach_volume" :: held 0.124s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:48 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" returned: 0 in 0.726s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17e5337-25de-4782-a1aa-10f75e24e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e4443-7b51-4304-9822-720b66748479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:48 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Volume volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c (d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c): created successfully Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8e4443-7b51-4304-9822-720b66748479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Flow 'volume_create_manager' (900c11d9-a5cb-4a25-890f-924bf8eb975d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c38b943a-934f-4c80-b580-ef084d411b61 tempest-VolumesTransfersV357Test-621142190 None] Created volume successfully. Apr 15 00:15:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Terminate volume connection completed successfully. Apr 15 00:15:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" by "detach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Detaching volume 656f2279-7c8f-482b-ac1c-f20213325831 from instance 6e83bdc7-d064-40a1-b28d-946150e40984. Apr 15 00:15:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Detach volume completed successfully. Apr 15 00:15:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a95b6b6-9f46-4d43-8b1e-5c11a497eff8 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-cffcd018-6686-4797-a01d-8ae0f6b11327 tempest-VolumesTransfersV357Test-1678334222 None] Transfer volume completed successfully. Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dbf0e133-ed30-45a5-82c0-68731ebb651f tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" by "detach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dbf0e133-ed30-45a5-82c0-68731ebb651f tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:50 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-dbf0e133-ed30-45a5-82c0-68731ebb651f tempest-VolumesActionsTest-195479120 None] Volume detach called, but volume not attached. Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dbf0e133-ed30-45a5-82c0-68731ebb651f tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "cinder-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "cinder-quobyte-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-quobyte-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b8bc33-5416-41a4-90d0-6b04342a413e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:50 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c Apr 15 00:15:50 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-quobyte-656f2279-7c8f-482b-ac1c-f20213325831" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "cinder-quobyte-656f2279-7c8f-482b-ac1c-f20213325831" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a5d777-55eb-4227-9e47-e0d8d9818611]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:51 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 Apr 15 00:15:51 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:51 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:51 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c Apr 15 00:15:51 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:51 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831" returned: 0 in 0.657s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:51 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831 Apr 15 00:15:51 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:51 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" returned: 0 in 0.587s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-quobyte-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c" released by "delete_volume" :: held 1.255s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Created reservations ['9794c5a4-6c12-483b-9045-0e824ba202e7', '0e03d538-39d9-42ea-9b58-a63fc0b4f030', '97c4bd24-9b0b-4dc6-8637-5749638de87d', '5c8ecd99-ff1f-4be6-bff8-8fdf35e4d1df'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:51 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:51 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:52 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-656f2279-7c8f-482b-ac1c-f20213325831" returned: 0 in 0.645s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "cinder-quobyte-656f2279-7c8f-482b-ac1c-f20213325831" released by "delete_volume" :: held 1.351s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Created reservations ['b18e8f60-2f3f-4b4a-b880-2dfca8c1832f', 'fac10bd3-988c-4604-bba5-d5a8ee34242a', '3036acca-14d0-44b6-bd43-9abc216d5295', '3eac4a5e-488c-4246-9fce-09e4f1f7eea1'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:52 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:52 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:52 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.633s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:52 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Deleted volume successfully. Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6242bfdb-0876-4601-9c65-48b537d7aeef tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-d2ec7f99-7ae4-4b81-92c7-2699a6dc9b2c-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:52 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Flow 'volume_create_manager' (d1d38425-f17e-40b9-a526-6c7c30d5ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec69560-fe02-4652-8b8a-985921709a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec69560-fe02-4652-8b8a-985921709a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1207914493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2945dc0033da4ec9bf93ff8fcca14276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:53Z,use_quota=True,user_id='94c36df2a1a643e4a7b603c57e32e1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95626b7e-2713-4c90-a12a-7b62cd9539e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95626b7e-2713-4c90-a12a-7b62cd9539e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89ddf9-ad78-4a27-9ad2-318424c7be37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c89ddf9-ad78-4a27-9ad2-318424c7be37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb', 'volume_name': 'volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b312e2-d6aa-42d1-b338-3b87a8920ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b312e2-d6aa-42d1-b338-3b87a8920ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238d9b16-d750-42f3-aef4-7712a743a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Volume 8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb', 'volume_size': 1} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1207914493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2945dc0033da4ec9bf93ff8fcca14276',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:15:53Z,use_quota=True,user_id='94c36df2a1a643e4a7b603c57e32e1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Creating volume 8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:15:53 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:53 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb 1073741824 Apr 15 00:15:53 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:53 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.658s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:53 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Deleted volume successfully. Apr 15 00:15:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09a44160-7634-42b7-a663-c9984b1dac94 tempest-VolumesActionsTest-195479120 None] Lock "cinder-656f2279-7c8f-482b-ac1c-f20213325831-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:54 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb 1073741824" returned: 0 in 1.159s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:54 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb Apr 15 00:15:54 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:54 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" returned: 0 in 0.562s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238d9b16-d750-42f3-aef4-7712a743a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726139cb-97a1-4ff0-b238-b8bd723fcad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:15:54 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Volume volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb (8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb): created successfully Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726139cb-97a1-4ff0-b238-b8bd723fcad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:15:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Flow 'volume_create_manager' (d1d38425-f17e-40b9-a526-6c7c30d5ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:15:54 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a27749c2-c73d-45ef-a2f6-a35899aa0f61 tempest-VolumesTransfersV357Test-621142190 None] Created volume successfully. Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "cinder-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "cinder-quobyte-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-quobyte-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[50670202-6f2a-462c-a243-eb776336cf02]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:15:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:55 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb Apr 15 00:15:55 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:56 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:56 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb Apr 15 00:15:56 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:56 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-quobyte-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb" released by "delete_volume" :: held 1.075s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Created reservations ['5ba8fb0f-4dc8-4e90-b1c3-993dffae6446', '5fd38258-7bf6-4ef4-a7dc-1f57fe107679', '99fa004c-0ea4-44da-b473-42d24c504369', 'ae4dc54d-6dd7-4767-b7b4-876c8d8f7c49'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:15:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:15:56 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:15:56 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:15:57 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 15 00:15:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.609s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:15:57 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:15:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Deleted volume successfully. Apr 15 00:15:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fb0bc301-9b99-46c3-802b-87bcacc203c0 tempest-VolumesTransfersV357Test-1028426732 None] Lock "cinder-8413b48a-0ae2-4a96-bdfc-5aaccb4ef4eb-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=80,cinder:DELETE=6,cinder:UPDATE=90,cinder:INSERT=15 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=76,cinder:UPDATE=73,cinder:INSERT=35,cinder:DELETE=7 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (266e6fe9-56b7-452b-933d-811e26110b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e72e43d-5047-45b5-8808-f2a33a14da1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e72e43d-5047-45b5-8808-f2a33a14da1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-291678351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c91bacc-e32c-4b03-9359-9455e415cd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:01Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca60266-93dc-4e94-90a1-2fd7ed897820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca60266-93dc-4e94-90a1-2fd7ed897820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51212e7-a3a1-4d71-be2f-dc75c09ee8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51212e7-a3a1-4d71-be2f-dc75c09ee8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c91bacc-e32c-4b03-9359-9455e415cd4e', 'volume_name': 'volume-1c91bacc-e32c-4b03-9359-9455e415cd4e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6970bf2-a75e-4426-834e-e8a33a7f8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6970bf2-a75e-4426-834e-e8a33a7f8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a62ef26-0eb6-4488-b051-ff8d506cf4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:00 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Volume 1c91bacc-e32c-4b03-9359-9455e415cd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c91bacc-e32c-4b03-9359-9455e415cd4e', 'volume_size': 1} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-291678351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c91bacc-e32c-4b03-9359-9455e415cd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:01Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Creating volume 1c91bacc-e32c-4b03-9359-9455e415cd4e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:00 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:00 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e 1073741824 Apr 15 00:16:00 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:02 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e 1073741824" returned: 0 in 1.307s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:02 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e Apr 15 00:16:02 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:02 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e" returned: 0 in 0.714s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a62ef26-0eb6-4488-b051-ff8d506cf4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c91bacc-e32c-4b03-9359-9455e415cd4e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a3e939-c86b-4290-90d8-b5f2a20a691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:02 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Volume volume-1c91bacc-e32c-4b03-9359-9455e415cd4e (1c91bacc-e32c-4b03-9359-9455e415cd4e): created successfully Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a3e939-c86b-4290-90d8-b5f2a20a691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (266e6fe9-56b7-452b-933d-811e26110b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-79c49fa8-ed90-4c1a-9a23-842efc8d154e tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-1c91bacc-e32c-4b03-9359-9455e415cd4e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-1c91bacc-e32c-4b03-9359-9455e415cd4e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-quobyte-1c91bacc-e32c-4b03-9359-9455e415cd4e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-1c91bacc-e32c-4b03-9359-9455e415cd4e" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75472a-21f3-4cb6-9c7c-599a7e6c4332]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:04 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e Apr 15 00:16:04 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:04 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e" returned: 0 in 0.642s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:04 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e Apr 15 00:16:04 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:05 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1c91bacc-e32c-4b03-9359-9455e415cd4e" returned: 0 in 0.642s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-1c91bacc-e32c-4b03-9359-9455e415cd4e" released by "delete_volume" :: held 1.355s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Created reservations ['349235d6-5e82-441b-9e7a-7ba5fd6a6dbf', 'a9b3d6de-785e-4216-a8ab-9812ec598a15', '59c152a5-9934-48dc-8112-d94c2f5d68fd', 'b3345f45-321e-4a4a-ab18-4e09ccf17d7a'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:05 devstack sudo[85974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:05 devstack sudo[85974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:06 devstack sudo[85974]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.500s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Deleted volume successfully. Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-da33df1f-8739-45c0-81bb-9c9eb16cd501 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-1c91bacc-e32c-4b03-9359-9455e415cd4e-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-0e617c32-e249-4c0d-bf6a-a9a12d24034e tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Terminate volume connection completed successfully. Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-0e617c32-e249-4c0d-bf6a-a9a12d24034e tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Deleting attachment 90842b22-a340-4cc9-8930-1c96757433b1. {{(pid=83219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (3bb89219-84e9-41b8-952e-1370e6bcffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e671f4ed-4a3b-4f81-8f1c-ca6025f9c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e671f4ed-4a3b-4f81-8f1c-ca6025f9c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590034018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a364acd6-63b4-4f3c-ac61-a53ee802e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:07Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36533ad8-ea1c-4083-9e99-31e324acb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36533ad8-ea1c-4083-9e99-31e324acb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa3c8c0-c8ea-424a-a2c7-55a023680c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa3c8c0-c8ea-424a-a2c7-55a023680c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a364acd6-63b4-4f3c-ac61-a53ee802e0a9', 'volume_name': 'volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a5c13-1007-4181-a1fd-28830a98c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923a5c13-1007-4181-a1fd-28830a98c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52232b9-3550-4a8d-a442-492ecb3e8bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Volume a364acd6-63b4-4f3c-ac61-a53ee802e0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9', 'volume_size': 1} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-590034018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a364acd6-63b4-4f3c-ac61-a53ee802e0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:07Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Creating volume a364acd6-63b4-4f3c-ac61-a53ee802e0a9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:06 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:06 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 1073741824 Apr 15 00:16:06 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "cinder-7c45789b-8bd1-41f6-b105-a499764b528f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-7c45789b-8bd1-41f6-b105-a499764b528f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "cinder-quobyte-7c45789b-8bd1-41f6-b105-a499764b528f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-quobyte-7c45789b-8bd1-41f6-b105-a499764b528f" acquired by "delete_volume" :: waited 0.029s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6683ca8-718b-4c02-b1df-2227c54c03c1]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:07 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:16:07 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:07 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 1073741824" returned: 0 in 1.155s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:08 devstack sudo[85985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 Apr 15 00:16:08 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:08 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 1.027s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:08 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:16:08 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:08 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" returned: 0 in 0.850s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52232b9-3550-4a8d-a442-492ecb3e8bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78030d2-1219-47bd-b729-5d07eb0eeada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Volume volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 (a364acd6-63b4-4f3c-ac61-a53ee802e0a9): created successfully Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78030d2-1219-47bd-b729-5d07eb0eeada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (3bb89219-84e9-41b8-952e-1370e6bcffbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:08 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7e238066-e20a-49ae-b32c-e126fb6b90f0 tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:16:09 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 1 in 0.972s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:16:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:09 devstack sudo[85999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f Apr 15 00:16:09 devstack sudo[85999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:10 devstack sudo[85999]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7c45789b-8bd1-41f6-b105-a499764b528f" returned: 0 in 0.906s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-quobyte-7c45789b-8bd1-41f6-b105-a499764b528f" released by "delete_volume" :: held 3.027s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-a364acd6-63b4-4f3c-ac61-a53ee802e0a9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "cinder-a364acd6-63b4-4f3c-ac61-a53ee802e0a9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-quobyte-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.quota [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Created reservations ['a16c764b-2742-4e3e-8c78-4e68ec18379c', '3c1bbbbf-61fe-4f5e-952c-f8f0e55e81a8', 'b39971fa-dced-4717-8f33-25eceba9b0cc', '989a409c-a7f3-4c9f-8c8b-8eed2a5c157b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" acquired by "delete_volume" :: waited 0.044s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3df05b-a276-4ee7-9903-fbbef31a5d93]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:10 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:10 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:10 devstack sudo[86016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 Apr 15 00:16:10 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:11 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.655s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:11 devstack cinder-volume[83219]: DEBUG cinder.manager [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Deleted volume successfully. Apr 15 00:16:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3bc91ef-f5ac-4ffa-92db-9048ec7cc148 req-f2bf4dab-ff48-4d4c-a771-df482d5f1e7c tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-7c45789b-8bd1-41f6-b105-a499764b528f-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:11 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" returned: 0 in 0.898s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:11 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9 Apr 15 00:16:11 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:12 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" returned: 0 in 0.795s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-a364acd6-63b4-4f3c-ac61-a53ee802e0a9" released by "delete_volume" :: held 1.771s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Created reservations ['bd86dd1a-a704-4537-8bb2-3e6f1f204f22', '624cbb18-8bac-4ec0-8947-5b5a792b0d5d', '1840daef-5306-4a1b-bcf8-7df9d0d75e41', 'ad7eb020-9776-4f5a-bdb6-cd0b42a9277e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:12 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:12 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Flow 'volume_create_manager' (daa21c61-3702-469a-a5df-a5ea7156fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77473dc7-bfe9-492a-a553-13eb256eb0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77473dc7-bfe9-492a-a553-13eb256eb0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031977897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcd45541d6943fd8d9a055915aa7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:13Z,use_quota=True,user_id='eaceb1ac57594a97af7bab4e0868db2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacd2072-3623-4b4d-94d5-42a0494d8ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacd2072-3623-4b4d-94d5-42a0494d8ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c24ddd-a380-4378-b87b-5ffd45ce198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48c24ddd-a380-4378-b87b-5ffd45ce198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9', 'volume_name': 'volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d5366e-0fb1-49af-bda1-287042dbaadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d5366e-0fb1-49af-bda1-287042dbaadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c71563-b62c-4142-b21a-b5112deeb360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9', 'volume_size': 1} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1031977897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcd45541d6943fd8d9a055915aa7c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:13Z,use_quota=True,user_id='eaceb1ac57594a97af7bab4e0868db2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Creating volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:13 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:13 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.147s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:13 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 1073741824 Apr 15 00:16:13 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (c8127883-3b38-4af2-9779-83f2966942b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3d897-46de-4318-8f13-90cb8efb2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Deleted volume successfully. Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f3d897-46de-4318-8f13-90cb8efb2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-757137082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8f40f6-4423-4b0e-ad60-28165cd75f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:13Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d8d2dd-5c05-4b35-a357-0ff82da06222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d8d2dd-5c05-4b35-a357-0ff82da06222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae733bc7-866c-4948-9677-d84bf9a02927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae733bc7-866c-4948-9677-d84bf9a02927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8f40f6-4423-4b0e-ad60-28165cd75f03', 'volume_name': 'volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b621b9f-14a2-47d6-b493-cc00a173da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b621b9f-14a2-47d6-b493-cc00a173da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43202876-d87f-4e8d-9828-bae891c20051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Volume dc8f40f6-4423-4b0e-ad60-28165cd75f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03', 'volume_size': 1} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:13 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9254c55a-eaed-4122-ab63-6610cc5d716a tempest-VolumesActionsTest-1164106925 None] Lock "cinder-a364acd6-63b4-4f3c-ac61-a53ee802e0a9-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:14 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 1073741824" returned: 0 in 0.689s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:14 devstack sudo[86063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:16:14 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:14 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.461s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-757137082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8f40f6-4423-4b0e-ad60-28165cd75f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:13Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Creating volume dc8f40f6-4423-4b0e-ad60-28165cd75f03 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:14 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c71563-b62c-4142-b21a-b5112deeb360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b3ca85-ddd4-4ec9-9d4f-c28b5e9bd8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:14 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 1073741824 Apr 15 00:16:14 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:14 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Volume volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 (c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9): created successfully Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b3ca85-ddd4-4ec9-9d4f-c28b5e9bd8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Flow 'volume_create_manager' (daa21c61-3702-469a-a5df-a5ea7156fe97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e0cb806d-eb12-42b2-8d4a-4c3c7980e3d0 tempest-VolumesActionsTest-250678551 None] Created volume successfully. Apr 15 00:16:15 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 1073741824" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:15 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 Apr 15 00:16:15 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:16 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03" returned: 0 in 0.948s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43202876-d87f-4e8d-9828-bae891c20051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aff3c4f-1b9b-4516-b4bf-df317e83c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Volume volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 (dc8f40f6-4423-4b0e-ad60-28165cd75f03): created successfully Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aff3c4f-1b9b-4516-b4bf-df317e83c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (c8127883-3b38-4af2-9779-83f2966942b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-781f73d0-2e1c-4247-9b71-40b97d6296e8 tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-dc8f40f6-4423-4b0e-ad60-28165cd75f03-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "cinder-dc8f40f6-4423-4b0e-ad60-28165cd75f03-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-quobyte-dc8f40f6-4423-4b0e-ad60-28165cd75f03" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-dc8f40f6-4423-4b0e-ad60-28165cd75f03" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2ec15-afbc-4a0e-bb53-14d9a708acda]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:16 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 Apr 15 00:16:16 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:17 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03" returned: 0 in 0.618s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:17 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03 Apr 15 00:16:17 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:17 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dc8f40f6-4423-4b0e-ad60-28165cd75f03" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-dc8f40f6-4423-4b0e-ad60-28165cd75f03" released by "delete_volume" :: held 1.166s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Created reservations ['db39a167-8d80-4ea5-b53a-e4fc7a391afd', '49034882-72c5-42ad-a4ea-e5237a3494ca', '5f7edf5c-80f3-4720-ae42-2f6e2c80e5b9', '9fdc12a8-6285-40fc-81e4-2ddd7b260085'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:17 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:17 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:18 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.635s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:18 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Deleted volume successfully. Apr 15 00:16:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-91100baa-d4ca-4e9b-a962-e6912c7f896c tempest-VolumesActionsTest-1164106925 None] Lock "cinder-dc8f40f6-4423-4b0e-ad60-28165cd75f03-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (2cb104f9-6c7b-4a03-b476-75e807bfc6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd2f8d9-3f6a-4aa6-a09d-6dce9496d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd2f8d9-3f6a-4aa6-a09d-6dce9496d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909362661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8500aca0-2c9b-4f45-b399-63879add48c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:19Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280e0ae6-a105-4ae6-bb58-37f7a7f988b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280e0ae6-a105-4ae6-bb58-37f7a7f988b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcac3c1a-51ee-4e28-a8cc-d1e81b9a8501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcac3c1a-51ee-4e28-a8cc-d1e81b9a8501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8500aca0-2c9b-4f45-b399-63879add48c9', 'volume_name': 'volume-8500aca0-2c9b-4f45-b399-63879add48c9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cbe988-b602-4a3a-913d-fd3be150fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cbe988-b602-4a3a-913d-fd3be150fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b368ad64-a78d-478f-b943-0f41aa392d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:19 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Volume 8500aca0-2c9b-4f45-b399-63879add48c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8500aca0-2c9b-4f45-b399-63879add48c9', 'volume_size': 1} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909362661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8500aca0-2c9b-4f45-b399-63879add48c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:19Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Creating volume 8500aca0-2c9b-4f45-b399-63879add48c9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:19 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:19 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 1073741824 Apr 15 00:16:19 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:20 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 1073741824" returned: 0 in 1.138s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:20 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 Apr 15 00:16:20 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:21 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9" returned: 0 in 0.656s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b368ad64-a78d-478f-b943-0f41aa392d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8500aca0-2c9b-4f45-b399-63879add48c9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca8ad3a-f26b-4891-9fed-fc4d8f2e8b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Volume volume-8500aca0-2c9b-4f45-b399-63879add48c9 (8500aca0-2c9b-4f45-b399-63879add48c9): created successfully Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca8ad3a-f26b-4891-9fed-fc4d8f2e8b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (2cb104f9-6c7b-4a03-b476-75e807bfc6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fbc3d559-7758-4036-873a-55c273f76d9a tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-8500aca0-2c9b-4f45-b399-63879add48c9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-8500aca0-2c9b-4f45-b399-63879add48c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "cinder-quobyte-8500aca0-2c9b-4f45-b399-63879add48c9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-8500aca0-2c9b-4f45-b399-63879add48c9" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff85cab-aea9-4f6f-9a32-b73bf0735920]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:22 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 Apr 15 00:16:22 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-a3589e67-0b12-416c-9962-5412e428deb7 req-6af896b9-699b-457b-b901-a81920f014ef tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Terminate volume connection completed successfully. Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-a3589e67-0b12-416c-9962-5412e428deb7 req-6af896b9-699b-457b-b901-a81920f014ef tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Deleting attachment 7ab58547-d036-4fa7-a16c-d926b48809b0. {{(pid=83219) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 00:16:22 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9" returned: 0 in 0.784s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:22 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9 Apr 15 00:16:22 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "cinder-2be42595-16a7-45d2-aaf6-aed535bdeab3-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-2be42595-16a7-45d2-aaf6-aed535bdeab3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "cinder-quobyte-2be42595-16a7-45d2-aaf6-aed535bdeab3" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-quobyte-2be42595-16a7-45d2-aaf6-aed535bdeab3" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3768f09-abde-4970-9ad3-b6928c3da107]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:23 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 Apr 15 00:16:23 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:23 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-8500aca0-2c9b-4f45-b399-63879add48c9" returned: 0 in 0.784s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-quobyte-8500aca0-2c9b-4f45-b399-63879add48c9" released by "delete_volume" :: held 1.618s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Created reservations ['76eb4086-3e5b-4242-aa18-b0c39b70ebd4', '42d501dd-a980-479c-a6d4-85b55da31905', 'a4fe6fc2-87aa-4e7d-8b2a-1ab9ed8ca3dc', '8afa54d4-ada0-4d63-b0e5-5e80b30439a0'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:23 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:23 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:24 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3" returned: 0 in 0.918s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:24 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3 Apr 15 00:16:24 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:24 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (3bd96aa3-c276-4569-b77e-1b8bb1879e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0a2067-bfd6-4f67-9cd1-52c7bd58f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.734s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:24 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Deleted volume successfully. Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0a2067-bfd6-4f67-9cd1-52c7bd58f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-54352072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af41c13-d673-4226-8fbd-4d57d6ed2ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:24Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ee083-79e3-4c28-aae6-e4c53a0e6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ee083-79e3-4c28-aae6-e4c53a0e6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77955df8-75ec-4b2a-a390-c4b0b3cb6b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77955df8-75ec-4b2a-a390-c4b0b3cb6b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af41c13-d673-4226-8fbd-4d57d6ed2ea8', 'volume_name': 'volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7089a44-0166-4ef2-8b0e-01f894db12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7089a44-0166-4ef2-8b0e-01f894db12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c909a2-80d3-40c3-8c2d-ab915d7119da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:24 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Volume 3af41c13-d673-4226-8fbd-4d57d6ed2ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8', 'volume_size': 1} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-54352072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af41c13-d673-4226-8fbd-4d57d6ed2ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a14601286c46888a0c2044ae10e0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:24Z,use_quota=True,user_id='68d55472d9464ded9680eaf11d64e2a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Creating volume 3af41c13-d673-4226-8fbd-4d57d6ed2ea8 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:24 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42cba693-0dce-467c-b326-6f2203eb7d54 tempest-VolumesActionsTest-1164106925 None] Lock "cinder-8500aca0-2c9b-4f45-b399-63879add48c9-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:24 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 1073741824 Apr 15 00:16:24 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:24 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2be42595-16a7-45d2-aaf6-aed535bdeab3" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-quobyte-2be42595-16a7-45d2-aaf6-aed535bdeab3" released by "delete_volume" :: held 1.532s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.quota [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Created reservations ['e08c2483-b495-4baa-b412-b2af23f19b2d', 'af4b3f65-3488-4410-bebd-60958e05d62d', '919427e2-0d7e-4b71-a7b0-4759483ca577', '371ff5e6-2d52-43d4-a421-c12074f23b80'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:24 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:24 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:25 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 1073741824" returned: 0 in 0.693s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:25 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.manager [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Deleted volume successfully. Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-a3589e67-0b12-416c-9962-5412e428deb7 req-f8f9ddb1-d5fc-4588-8062-755cbcc7c00b tempest-ServerBootFromVolumeStableRescueTest-920722975 None] Lock "cinder-2be42595-16a7-45d2-aaf6-aed535bdeab3-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:25 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 Apr 15 00:16:25 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:25 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c909a2-80d3-40c3-8c2d-ab915d7119da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9715f59b-a376-4196-8183-4816833b2644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:25 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Volume volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 (3af41c13-d673-4226-8fbd-4d57d6ed2ea8): created successfully Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9715f59b-a376-4196-8183-4816833b2644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Flow 'volume_create_manager' (3bd96aa3-c276-4569-b77e-1b8bb1879e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-62dfe4c9-3315-44d3-81d9-369474dc7436 tempest-VolumesActionsTest-195479120 None] Created volume successfully. Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-3af41c13-d673-4226-8fbd-4d57d6ed2ea8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "cinder-3af41c13-d673-4226-8fbd-4d57d6ed2ea8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Acquiring lock "cinder-quobyte-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "cinder-quobyte-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5713f400-22fa-4c53-b60e-e602ce449c41]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:27 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 Apr 15 00:16:27 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:27 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Flow 'volume_create_manager' (7aa08f7a-056f-4466-9cfe-99762a04911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24f04af-8722-4f8a-b9ce-ad1c550f6194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" returned: 0 in 0.786s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24f04af-8722-4f8a-b9ce-ad1c550f6194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2065804261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc038a1-643f-4f96-bbcc-3cbcb3af6268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a913f9e8ec3e41e08a99da3cabcb90fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:28Z,use_quota=True,user_id='fcaa47235f69455b9f0dd099036c579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a1d19d-b74b-458e-be61-9976a5372028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a1d19d-b74b-458e-be61-9976a5372028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202a311a-e8fa-4fc2-b584-6b287426bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202a311a-e8fa-4fc2-b584-6b287426bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cc038a1-643f-4f96-bbcc-3cbcb3af6268', 'volume_name': 'volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:28 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8 Apr 15 00:16:28 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76918b2b-dd2c-40a8-87dc-23dde96e2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76918b2b-dd2c-40a8-87dc-23dde96e2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08123d48-c258-492f-986c-ada3a8157cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:28 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Volume 5cc038a1-643f-4f96-bbcc-3cbcb3af6268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268', 'volume_size': 1} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2065804261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc038a1-643f-4f96-bbcc-3cbcb3af6268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a913f9e8ec3e41e08a99da3cabcb90fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:28Z,use_quota=True,user_id='fcaa47235f69455b9f0dd099036c579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Creating volume 5cc038a1-643f-4f96-bbcc-3cbcb3af6268 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:28 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:28 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 1073741824 Apr 15 00:16:28 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:28 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "cinder-quobyte-3af41c13-d673-4226-8fbd-4d57d6ed2ea8" released by "delete_volume" :: held 1.333s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Created reservations ['19ca57a7-5ce6-40fc-a69b-8e6b0f560fed', '081cc181-5932-4cc3-ac89-c059fac8cd90', '4a37b4ad-469b-4c7b-8787-a025fd073d09', 'c6a2c61a-957e-4917-b945-2437f631d529'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:28 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:28 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:28 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 1073741824" returned: 0 in 0.548s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:28 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 Apr 15 00:16:28 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:29 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.919s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Deleted volume successfully. Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-acd69c94-1c7d-4795-a6ea-c0e49fca37a9 tempest-VolumesActionsTest-195479120 None] Lock "cinder-3af41c13-d673-4226-8fbd-4d57d6ed2ea8-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:29 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" returned: 0 in 0.934s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08123d48-c258-492f-986c-ada3a8157cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef052a9b-9aef-4c0f-884a-833c97dd137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Volume volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 (5cc038a1-643f-4f96-bbcc-3cbcb3af6268): created successfully Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef052a9b-9aef-4c0f-884a-833c97dd137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Flow 'volume_create_manager' (7aa08f7a-056f-4466-9cfe-99762a04911f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-514b0106-b32f-42e9-99e6-e7483c419ee5 tempest-ServersNegativeTestJSON-1084402091 None] Created volume successfully. Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Flow 'volume_create_manager' (4e77f482-d188-4ebb-8e81-ab6fd5ccc821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f725614-8580-4812-be56-42dca5163d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f725614-8580-4812-be56-42dca5163d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110081797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5575d-8826-4272-a734-985553b5909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a913f9e8ec3e41e08a99da3cabcb90fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:31Z,use_quota=True,user_id='fcaa47235f69455b9f0dd099036c579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7f200d-593d-4df6-bda5-cc8594f74b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7f200d-593d-4df6-bda5-cc8594f74b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afabe2ba-db22-4c51-b5a1-ca0dd8173a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afabe2ba-db22-4c51-b5a1-ca0dd8173a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff5575d-8826-4272-a734-985553b5909e', 'volume_name': 'volume-dff5575d-8826-4272-a734-985553b5909e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbdf4a8-1c26-439f-b5c1-d1fd8c433213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccbdf4a8-1c26-439f-b5c1-d1fd8c433213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec39a92-de58-48e7-a514-643ce3ae8965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Volume dff5575d-8826-4272-a734-985553b5909e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff5575d-8826-4272-a734-985553b5909e', 'volume_size': 1} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110081797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5575d-8826-4272-a734-985553b5909e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a913f9e8ec3e41e08a99da3cabcb90fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:31Z,use_quota=True,user_id='fcaa47235f69455b9f0dd099036c579b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Creating volume dff5575d-8826-4272-a734-985553b5909e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:31 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:31 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e 1073741824 Apr 15 00:16:31 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:32 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e 1073741824" returned: 0 in 1.030s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:32 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e Apr 15 00:16:32 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:32 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e" returned: 0 in 0.606s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec39a92-de58-48e7-a514-643ce3ae8965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff5575d-8826-4272-a734-985553b5909e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf64cfc-c68e-4bac-828f-30fd87b6b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:32 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Volume volume-dff5575d-8826-4272-a734-985553b5909e (dff5575d-8826-4272-a734-985553b5909e): created successfully Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf64cfc-c68e-4bac-828f-30fd87b6b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Flow 'volume_create_manager' (4e77f482-d188-4ebb-8e81-ab6fd5ccc821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:32 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-56e21542-1458-4419-a0a4-8e687582ed69 tempest-ServersNegativeTestJSON-1084402091 None] Created volume successfully. Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-642577da-63d0-45ff-a4a4-445cceae16bf tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" by "attach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-642577da-63d0-45ff-a4a4-445cceae16bf tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" acquired by "attach_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "cinder-dff5575d-8826-4272-a734-985553b5909e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-642577da-63d0-45ff-a4a4-445cceae16bf tempest-VolumesActionsTest-250678551 None] Attaching volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 to instance a9a29edc-f87a-457d-bbf4-49e7f6a06cf7 at mountpoint /dev/vdb on host None. Apr 15 00:16:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-642577da-63d0-45ff-a4a4-445cceae16bf tempest-VolumesActionsTest-250678551 None] Attach volume completed successfully. Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-dff5575d-8826-4272-a734-985553b5909e-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-642577da-63d0-45ff-a4a4-445cceae16bf tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" released by "attach_volume" :: held 0.153s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "cinder-quobyte-dff5575d-8826-4272-a734-985553b5909e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-quobyte-dff5575d-8826-4272-a734-985553b5909e" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb607f-d123-405f-8347-79409afb7794]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:34 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e Apr 15 00:16:34 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5694520c-76b4-4056-9ab9-fd80f8f49455 tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" by "detach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5694520c-76b4-4056-9ab9-fd80f8f49455 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5694520c-76b4-4056-9ab9-fd80f8f49455 tempest-VolumesActionsTest-250678551 None] Detaching volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 from instance a9a29edc-f87a-457d-bbf4-49e7f6a06cf7. Apr 15 00:16:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5694520c-76b4-4056-9ab9-fd80f8f49455 tempest-VolumesActionsTest-250678551 None] Detach volume completed successfully. Apr 15 00:16:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5694520c-76b4-4056-9ab9-fd80f8f49455 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:35 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e" returned: 0 in 0.764s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:35 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e Apr 15 00:16:35 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:36 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dff5575d-8826-4272-a734-985553b5909e" returned: 0 in 0.656s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-quobyte-dff5575d-8826-4272-a734-985553b5909e" released by "delete_volume" :: held 1.478s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Created reservations ['f8904be9-6c8f-47cf-b7a8-b8515fcc2410', 'a1aacba9-2751-4848-a9f5-1c918589ad24', 'a5c36f21-0d24-4f92-831a-172837043091', '9a5ed91e-8c1a-4811-992b-2cd10ecc3a57'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:36 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:36 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "cinder-5cc038a1-643f-4f96-bbcc-3cbcb3af6268-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-5cc038a1-643f-4f96-bbcc-3cbcb3af6268-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "cinder-quobyte-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-quobyte-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" acquired by "delete_volume" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc3a03a-276d-4452-b17f-36e53be7c208]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:36 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.722s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Deleted volume successfully. Apr 15 00:16:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-15d18998-5a3a-46ee-862a-b7258938e362 tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-dff5575d-8826-4272-a734-985553b5909e-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:36 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 Apr 15 00:16:36 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:37 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" returned: 0 in 0.663s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:37 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268 Apr 15 00:16:37 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:38 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" returned: 0 in 0.614s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-quobyte-5cc038a1-643f-4f96-bbcc-3cbcb3af6268" released by "delete_volume" :: held 1.330s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Created reservations ['1eb178c7-a420-4441-af44-9a49135e0f03', '59c1a58b-b4f0-4d38-8128-03f8f0115c7f', 'e13a84f9-5d2d-49a8-b568-530b054faa6f', 'ab6dec99-20ee-4977-85bc-e638c5949207'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:38 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:38 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:38 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.573s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Deleted volume successfully. Apr 15 00:16:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0aeee321-998f-42ed-af96-eaaed9263e6c tempest-ServersNegativeTestJSON-1084402091 None] Lock "cinder-5cc038a1-643f-4f96-bbcc-3cbcb3af6268-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Flow 'volume_create_manager' (568c57cd-adc2-408a-9d35-b846e06dff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf3e731-539f-40a4-a0af-f4ba52e4fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf3e731-539f-40a4-a0af-f4ba52e4fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-31520051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7123d76c-9c2f-43f3-86bd-4a63094a97cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818f0927357740fe999c4cf5d3cc6c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:41Z,use_quota=True,user_id='05f927d4e15a47419202cb29c3a7e30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6997c08f-fd9a-4f15-94c8-0fd6381cb191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6997c08f-fd9a-4f15-94c8-0fd6381cb191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be752f46-66fc-4b93-aabe-b1e4015b959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be752f46-66fc-4b93-aabe-b1e4015b959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7123d76c-9c2f-43f3-86bd-4a63094a97cc', 'volume_name': 'volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e17d1-cd57-4962-9901-865b0ec6da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3e17d1-cd57-4962-9901-865b0ec6da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d0fdea-0ccd-4173-96da-0f46490dbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:40 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Volume 7123d76c-9c2f-43f3-86bd-4a63094a97cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc', 'volume_size': 1} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-31520051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7123d76c-9c2f-43f3-86bd-4a63094a97cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818f0927357740fe999c4cf5d3cc6c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:41Z,use_quota=True,user_id='05f927d4e15a47419202cb29c3a7e30a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Creating volume 7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:40 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:40 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc 1073741824 Apr 15 00:16:40 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:41 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc 1073741824" returned: 0 in 0.538s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:41 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc Apr 15 00:16:41 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:41 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc" returned: 0 in 0.484s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d0fdea-0ccd-4173-96da-0f46490dbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ca08f-bd08-46df-81ab-2fb0516ebe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Volume volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc (7123d76c-9c2f-43f3-86bd-4a63094a97cc): created successfully Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ca08f-bd08-46df-81ab-2fb0516ebe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Flow 'volume_create_manager' (568c57cd-adc2-408a-9d35-b846e06dff8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-465c327b-7774-47ad-850e-497381c4792b tempest-SnapshotMetadataTestJSON-966947527 None] Created volume successfully. Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:42 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:42 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:42 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Creating offline snapshot d0d2f5d4-034b-4865-926d-75e1c7dc88c2 of volume 7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[853d89ea-8356-497c-a4ae-cfe0906a0a89]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:43 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc Apr 15 00:16:43 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:43 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc" returned: 0 in 0.638s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:43 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 1G Apr 15 00:16:43 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:44 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 1G" returned: 0 in 0.650s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:44 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 Apr 15 00:16:44 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:44 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2" returned: 0 in 0.526s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:44 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 is being set with open permissions: ugo+rw Apr 15 00:16:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:44 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 Apr 15 00:16:44 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:45 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2" returned: 0 in 0.560s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:45 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info Apr 15 00:16:45 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:46 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info" returned: 0 in 0.519s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:46 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info is being set with open permissions: ugo+rw Apr 15 00:16:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:46 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info Apr 15 00:16:46 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:46 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.info" returned: 0 in 0.521s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.487s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7036af8f-b296-4ba9-8c19-3c013b7a44d0 tempest-SnapshotMetadataTestJSON-966947527 None] Create snapshot completed successfully Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "cinder-d0d2f5d4-034b-4865-926d-75e1c7dc88c2-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-d0d2f5d4-034b-4865-926d-75e1c7dc88c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "cinder-quobyte-d0d2f5d4-034b-4865-926d-75e1c7dc88c2" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-d0d2f5d4-034b-4865-926d-75e1c7dc88c2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Deleting offline snapshot d0d2f5d4-034b-4865-926d-75e1c7dc88c2 of volume 7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] snapshot_file for this snap is: volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb76736-3c9e-4916-b810-b3f73a04f5ed]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:48 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 Apr 15 00:16:48 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:48 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2" returned: 0 in 0.578s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:16:48 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6005852-8b0b-46a5-9cd3-4a66ab7ddfa3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:48 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc Apr 15 00:16:48 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:49 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc" returned: 0 in 0.658s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:49 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 Apr 15 00:16:49 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:49 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2" returned: 0 in 0.575s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:49 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2 Apr 15 00:16:49 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:50 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc.d0d2f5d4-034b-4865-926d-75e1c7dc88c2" returned: 0 in 0.497s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-d0d2f5d4-034b-4865-926d-75e1c7dc88c2" released by "_delete_snapshot" :: held 2.373s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" released by "delete_snapshot" :: held 2.394s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:50 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Created reservations ['6b25f3f1-a8dc-43ae-978c-776d5fd1379a', '2da6cbe1-cee1-419d-87c9-cefa167c220e', '0869426e-83bb-44d6-828b-1baf7eb29097', '13c50beb-b391-40b1-a84d-3563e8a7f618'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:50 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Delete snapshot completed successfully. Apr 15 00:16:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-eb49e669-4d59-400c-a118-23114dffb1f4 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-d0d2f5d4-034b-4865-926d-75e1c7dc88c2-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "cinder-7123d76c-9c2f-43f3-86bd-4a63094a97cc-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-7123d76c-9c2f-43f3-86bd-4a63094a97cc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" acquired by "delete_volume" :: waited 0.029s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507041b-b2f8-42fd-ae9e-4037f910c15e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:51 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc Apr 15 00:16:51 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Flow 'volume_create_manager' (96d90218-e896-4a75-a03c-7067dcee9841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33477eb3-3843-462f-9fca-5aa677cba430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33477eb3-3843-462f-9fca-5aa677cba430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1601583963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb662b9cef8d4bd582fb1683a8eb2200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:51Z,use_quota=True,user_id='88a4fe94f3014853acc8d9eef747552d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f1662-057c-4555-b16d-aadd1c867249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915f1662-057c-4555-b16d-aadd1c867249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aad7891-60bb-4a8d-b4fc-c553dfa0d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aad7891-60bb-4a8d-b4fc-c553dfa0d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d', 'volume_name': 'volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260798ce-62fa-4d5c-8eca-0e64d7a5faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260798ce-62fa-4d5c-8eca-0e64d7a5faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed7c5a-5388-4ad9-afdc-c8e54f7c62a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:51 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Volume 6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d', 'volume_size': 1} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1601583963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb662b9cef8d4bd582fb1683a8eb2200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:51Z,use_quota=True,user_id='88a4fe94f3014853acc8d9eef747552d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Creating volume 6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:51 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:51 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d 1073741824 Apr 15 00:16:51 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:51 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc" returned: 0 in 0.598s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:51 devstack sudo[86592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc Apr 15 00:16:51 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:52 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d 1073741824" returned: 0 in 0.633s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:52 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d Apr 15 00:16:52 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:52 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7123d76c-9c2f-43f3-86bd-4a63094a97cc" returned: 0 in 0.564s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-quobyte-7123d76c-9c2f-43f3-86bd-4a63094a97cc" released by "delete_volume" :: held 1.218s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Created reservations ['54d9177a-acb2-4fcd-84e2-926a25b52de4', '0f31b5c3-e3ea-4836-aca1-d27c42c0e4db', 'e11d5903-424f-48fc-b882-b4e700f85025', '88bbdc00-ef5e-454a-854d-e7f197b51bcf'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:52 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:16:52 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:52 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" returned: 0 in 0.650s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ed7c5a-5388-4ad9-afdc-c8e54f7c62a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c8dd0e-18a6-42f3-baa6-fd6a597c9618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:52 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Volume volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d (6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d): created successfully Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6c8dd0e-18a6-42f3-baa6-fd6a597c9618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Flow 'volume_create_manager' (96d90218-e896-4a75-a03c-7067dcee9841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:52 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-16853d1a-ec91-44fd-bd29-6896af1d5fb4 req-5b7eead0-f482-493c-9589-1286012f9494 tempest-VolumesSnapshotsTestJSON-980844822 None] Created volume successfully. Apr 15 00:16:53 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.558s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:53 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:16:53 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Deleted volume successfully. Apr 15 00:16:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-109b8717-aeb6-4d18-aa7a-f69b18cca672 tempest-SnapshotMetadataTestJSON-966947527 None] Lock "cinder-7123d76c-9c2f-43f3-86bd-4a63094a97cc-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Creating offline snapshot 79b34a1d-cce0-45ee-b51a-f7b3697bdd7a of volume 6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:16:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f49c4-2d3b-4c68-b667-4ca9eafd65e9]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:54 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d Apr 15 00:16:54 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:55 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" returned: 0 in 0.832s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:55 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a 1G Apr 15 00:16:55 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:55 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a 1G" returned: 0 in 0.640s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:55 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:16:55 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a Apr 15 00:16:55 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Flow 'volume_create_manager' (54e65b31-09d5-437b-ad4c-ca5cab1848f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb1dbd-9b6d-4706-9ccf-ad8bb932b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb1dbd-9b6d-4706-9ccf-ad8bb932b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1425091142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6711b7-c932-410b-98be-36bcfd1220e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62b2c753bff4f3ab93e7e9e9ea6bfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:56Z,use_quota=True,user_id='8c96b089c8f149a2bcde3d5ef0a0c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b61aa2a-7388-4f5a-987e-78d355b8e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b61aa2a-7388-4f5a-987e-78d355b8e306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deff97f-972a-4b94-9cf5-87a8c71f0b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0deff97f-972a-4b94-9cf5-87a8c71f0b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6711b7-c932-410b-98be-36bcfd1220e5', 'volume_name': 'volume-1d6711b7-c932-410b-98be-36bcfd1220e5', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3cc936-6cd0-4a97-844b-218339303292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3cc936-6cd0-4a97-844b-218339303292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f425dcd2-9fe4-46e3-84d4-97254470847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:56 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Volume 1d6711b7-c932-410b-98be-36bcfd1220e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6711b7-c932-410b-98be-36bcfd1220e5', 'volume_size': 1} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:56 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:56 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a is being set with open permissions: ugo+rw Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:56 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a Apr 15 00:16:56 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:56 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" returned: 0 in 0.457s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:56 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info Apr 15 00:16:56 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:57 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:57 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info is being set with open permissions: ugo+rw Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:57 devstack sudo[86700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info Apr 15 00:16:57 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:57 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.info" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.412s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1425091142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6711b7-c932-410b-98be-36bcfd1220e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62b2c753bff4f3ab93e7e9e9ea6bfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:16:56Z,use_quota=True,user_id='8c96b089c8f149a2bcde3d5ef0a0c8a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Creating volume 1d6711b7-c932-410b-98be-36bcfd1220e5 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:16:57 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:16:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:57 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 1073741824 Apr 15 00:16:57 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-812aa85d-3062-4795-8134-feae3fcf5e79 req-1637b890-a2e1-44cd-9b06-7b24c2690831 tempest-VolumesSnapshotsTestJSON-980844822 None] Create snapshot completed successfully Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "cinder-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "cinder-quobyte-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Deleting offline snapshot 79b34a1d-cce0-45ee-b51a-f7b3697bdd7a of volume 6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] snapshot_file for this snap is: volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaecfa7-8df0-412c-8628-4d5b90a4909e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:58 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a Apr 15 00:16:58 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:59 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 1073741824" returned: 0 in 1.138s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:59 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 Apr 15 00:16:59 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-3e621e50-f1a9-426a-9b46-65d241afe0d9 tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" by "attach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-3e621e50-f1a9-426a-9b46-65d241afe0d9 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" acquired by "attach_volume" :: waited 0.027s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:16:59 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" returned: 0 in 1.132s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[16450488-6fdd-4e70-b08b-c5237a12c520]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:16:59 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d Apr 15 00:16:59 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:16:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-3e621e50-f1a9-426a-9b46-65d241afe0d9 tempest-VolumesActionsTest-250678551 None] Attaching volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 to instance 04cf19af-77eb-4b8c-9100-1c9a955aaf73 at mountpoint /dev/vdb on host None. Apr 15 00:16:59 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5" returned: 0 in 0.854s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:16:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-3e621e50-f1a9-426a-9b46-65d241afe0d9 tempest-VolumesActionsTest-250678551 None] Attach volume completed successfully. Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f425dcd2-9fe4-46e3-84d4-97254470847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6711b7-c932-410b-98be-36bcfd1220e5', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4eb832-1961-4d17-9658-7df6c182feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-3e621e50-f1a9-426a-9b46-65d241afe0d9 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" released by "attach_volume" :: held 0.242s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:16:59 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Volume volume-1d6711b7-c932-410b-98be-36bcfd1220e5 (1d6711b7-c932-410b-98be-36bcfd1220e5): created successfully Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4eb832-1961-4d17-9658-7df6c182feb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:16:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Flow 'volume_create_manager' (54e65b31-09d5-437b-ad4c-ca5cab1848f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:16:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-249f11ab-bebd-4d9f-a803-55849f1d11a7 tempest-VolumesMetadataTest-1169697113 None] Created volume successfully. Apr 15 00:17:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-52dc7a0f-7f4f-4348-a78d-969079222103 tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" by "detach_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-52dc7a0f-7f4f-4348-a78d-969079222103 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:00 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-52dc7a0f-7f4f-4348-a78d-969079222103 tempest-VolumesActionsTest-250678551 None] Detaching volume c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 from instance 04cf19af-77eb-4b8c-9100-1c9a955aaf73. Apr 15 00:17:00 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" returned: 0 in 0.655s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:00 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a Apr 15 00:17:00 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:00 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-52dc7a0f-7f4f-4348-a78d-969079222103 tempest-VolumesActionsTest-250678551 None] Detach volume completed successfully. Apr 15 00:17:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-52dc7a0f-7f4f-4348-a78d-969079222103 tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:01 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" returned: 0 in 0.735s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:01 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a Apr 15 00:17:01 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Acquiring lock "cinder-1d6711b7-c932-410b-98be-36bcfd1220e5-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "cinder-1d6711b7-c932-410b-98be-36bcfd1220e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=99,cinder:INSERT=30,cinder:UPDATE=139,cinder:DELETE=10 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=100,cinder:UPDATE=116,cinder:DELETE=13,cinder:INSERT=31 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Acquiring lock "cinder-quobyte-1d6711b7-c932-410b-98be-36bcfd1220e5" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "cinder-quobyte-1d6711b7-c932-410b-98be-36bcfd1220e5" acquired by "delete_volume" :: waited 0.033s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[661deb89-a7f3-4da5-9c36-b165ddac165d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:01 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d.79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" returned: 0 in 0.739s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:01 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 Apr 15 00:17:01 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a" released by "_delete_snapshot" :: held 3.442s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" released by "delete_snapshot" :: held 3.484s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG cinder.quota [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Created reservations ['3c35bdcb-edac-4053-aa63-8d200e130036', 'a8ae0317-c5a5-446d-9241-e081abb53f05', 'ba330b50-2bef-4632-b55d-c3c7dd03b2b6', '604d9454-64bf-4498-8549-3a87a80be143'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Delete snapshot completed successfully. Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-6125312b-5c08-4f51-aedd-0cb3c9ce82ea req-d406e708-1203-48e2-bb0c-a4bb9c1f0d3b tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-79b34a1d-cce0-45ee-b51a-f7b3697bdd7a-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:02 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5" returned: 0 in 0.661s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:02 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5 Apr 15 00:17:02 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:03 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1d6711b7-c932-410b-98be-36bcfd1220e5" returned: 0 in 0.747s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "cinder-quobyte-1d6711b7-c932-410b-98be-36bcfd1220e5" released by "delete_volume" :: held 1.510s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Created reservations ['48a6f072-033b-4bd8-b408-75659e3ef624', '0fe7f9e8-c5e1-481c-b77e-9d67f89a84ca', '18e90768-42dc-4953-8c05-f96c216d6dbb', '7cd62a06-4ab5-48c0-87ee-3b2aedd9a6a5'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "cinder-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:03 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:03 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7874fca0-949c-4c2a-bd4e-5365e60a0b02]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:03 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d Apr 15 00:17:03 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:04 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" returned: 0 in 0.641s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:04 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d Apr 15 00:17:04 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:04 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.973s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:04 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:04 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Deleted volume successfully. Apr 15 00:17:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-94e218a0-bd31-4fbb-ab35-4f10776824d9 tempest-VolumesMetadataTest-1169697113 None] Lock "cinder-1d6711b7-c932-410b-98be-36bcfd1220e5-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:05 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" returned: 0 in 0.947s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-quobyte-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d" released by "delete_volume" :: held 1.634s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.quota [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Created reservations ['ef515985-b7ab-4ab0-ab0f-20e33ef09211', '0a53294e-7a2d-4540-90cb-6f39cf8ac0aa', '7554e28b-8802-4fd3-aaab-053cdca8610f', 'e12a0e0d-18c2-476f-9036-dbc7661f013d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:05 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:05 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:05 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.manager [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Deleted volume successfully. Apr 15 00:17:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-aa7088d6-4743-49c6-b32d-43ae0b9e6171 req-c54d1058-33c1-4e06-8835-f80a3b6ada44 tempest-VolumesSnapshotsTestJSON-980844822 None] Lock "cinder-6728bbfe-b186-4cbe-86e5-2a7bcbd3f13d-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Flow 'volume_create_manager' (b5fd7d2c-a4d8-4c1e-b34d-e49ef10e5ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2f61bb-8656-4253-b5d8-25cacc365589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2f61bb-8656-4253-b5d8-25cacc365589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-8056672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369cceb1-72f3-45ba-807a-bf628223dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c3d562b31e423ab64fd16cf1f070cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:07Z,use_quota=True,user_id='cca055772ee44540891648ece7883bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf5cff9-9e72-4251-aeca-379db94d23e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf5cff9-9e72-4251-aeca-379db94d23e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e99da-69f6-457c-8a57-c21314ee817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330e99da-69f6-457c-8a57-c21314ee817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '369cceb1-72f3-45ba-807a-bf628223dd6f', 'volume_name': 'volume-369cceb1-72f3-45ba-807a-bf628223dd6f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cea4ce-7ba0-4849-aa58-9a605a731b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cea4ce-7ba0-4849-aa58-9a605a731b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340d5bbc-220c-406e-a8ea-736df8a88156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Volume 369cceb1-72f3-45ba-807a-bf628223dd6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-369cceb1-72f3-45ba-807a-bf628223dd6f', 'volume_size': 1} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-8056672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=369cceb1-72f3-45ba-807a-bf628223dd6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c3d562b31e423ab64fd16cf1f070cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:07Z,use_quota=True,user_id='cca055772ee44540891648ece7883bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Creating volume 369cceb1-72f3-45ba-807a-bf628223dd6f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:07 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:07 devstack sudo[86846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f 1073741824 Apr 15 00:17:07 devstack sudo[86846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:08 devstack sudo[86846]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f 1073741824" returned: 0 in 0.779s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:08 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f Apr 15 00:17:08 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:08 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f" returned: 0 in 0.695s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:08 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Flow 'volume_create_manager' (4a5175d6-b6b0-4ba1-9fa9-0435a6818bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52252a0-4492-461d-8ac4-2a0ff360e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52252a0-4492-461d-8ac4-2a0ff360e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923524007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b750f6b2-8535-4a98-9a05-238370e20c06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0333d23b8444de8fce895195841e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:09Z,use_quota=True,user_id='50398e8c4e3444ddaab280fad16ffb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abf2437-f244-440c-aff1-f466dffa068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abf2437-f244-440c-aff1-f466dffa068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cfc7be-bf32-4596-939f-0884df0fbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cfc7be-bf32-4596-939f-0884df0fbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b750f6b2-8535-4a98-9a05-238370e20c06', 'volume_name': 'volume-b750f6b2-8535-4a98-9a05-238370e20c06', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cc4f3f-64f5-4a21-ac90-3ccadd1d2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cc4f3f-64f5-4a21-ac90-3ccadd1d2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c82d7da-feaa-4123-b62a-fad08b578eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Volume b750f6b2-8535-4a98-9a05-238370e20c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b750f6b2-8535-4a98-9a05-238370e20c06', 'volume_size': 1} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-923524007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b750f6b2-8535-4a98-9a05-238370e20c06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d0333d23b8444de8fce895195841e2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:09Z,use_quota=True,user_id='50398e8c4e3444ddaab280fad16ffb44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Creating volume b750f6b2-8535-4a98-9a05-238370e20c06 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:09 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340d5bbc-220c-406e-a8ea-736df8a88156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-369cceb1-72f3-45ba-807a-bf628223dd6f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d827340-1cd3-484a-9f77-3e1c23130ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Volume volume-369cceb1-72f3-45ba-807a-bf628223dd6f (369cceb1-72f3-45ba-807a-bf628223dd6f): created successfully Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d827340-1cd3-484a-9f77-3e1c23130ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:09 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 1073741824 Apr 15 00:17:09 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Flow 'volume_create_manager' (b5fd7d2c-a4d8-4c1e-b34d-e49ef10e5ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:09 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-67360479-83a9-4179-b0a1-802d3f543fbe tempest-VolumesNegativeTest-1387398379 None] Created volume successfully. Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:09 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 1073741824" returned: 0 in 0.565s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:09 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 Apr 15 00:17:09 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:10 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.735s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c82d7da-feaa-4123-b62a-fad08b578eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b750f6b2-8535-4a98-9a05-238370e20c06', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66c12f-17ef-4c94-91e4-223651b1557b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c8b7d-374c-4a43-b83f-217820d571df]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:10 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Volume volume-b750f6b2-8535-4a98-9a05-238370e20c06 (b750f6b2-8535-4a98-9a05-238370e20c06): created successfully Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66c12f-17ef-4c94-91e4-223651b1557b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Flow 'volume_create_manager' (4a5175d6-b6b0-4ba1-9fa9-0435a6818bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-28786d69-33cd-41ac-a0b1-ec9e5e5b5120 req-c189d0f2-62f7-4d92-a0cf-2ee1e7a5f636 tempest-VolumesGetTestJSON-377498820 None] Created volume successfully. Apr 15 00:17:10 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:10 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:10 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.525s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2de5102-1e3e-4f0d-8a49-7f1a82120179]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:10 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:10 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:11 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.fbfda0ff-0dbe-4935-a496-12e972c101f1gcgw0ac3.img {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:11 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.fbfda0ff-0dbe-4935-a496-12e972c101f1gcgw0ac3.img Apr 15 00:17:11 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Acquiring lock "cinder-b750f6b2-8535-4a98-9a05-238370e20c06-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "cinder-b750f6b2-8535-4a98-9a05-238370e20c06-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Acquiring lock "cinder-quobyte-b750f6b2-8535-4a98-9a05-238370e20c06" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "cinder-quobyte-b750f6b2-8535-4a98-9a05-238370e20c06" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[60de9ba9-87b4-4e9d-a9a3-4a3dee4ca688]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:11 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 Apr 15 00:17:11 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:12 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06" returned: 0 in 1.025s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:12 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06 Apr 15 00:17:12 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:14 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b750f6b2-8535-4a98-9a05-238370e20c06" returned: 0 in 2.228s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "cinder-quobyte-b750f6b2-8535-4a98-9a05-238370e20c06" released by "delete_volume" :: held 3.278s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG cinder.quota [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Created reservations ['8e54ac0a-7b8e-4684-941a-956216363d87', '1b9c07b7-c1d6-4ae6-82c2-3b278c1a3b7f', '7294d86e-06a5-46e9-9498-3528690c1010', 'fc513b18-644b-46e6-aae1-dcd90b9d6567'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:14 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:14 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:14 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.fbfda0ff-0dbe-4935-a496-12e972c101f1gcgw0ac3.img" returned: 0 in 3.691s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecb1682-498e-4cb3-a7d9-09c218d6b6be]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:15 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:15 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:16 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.446s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG cinder.manager [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Deleted volume successfully. Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [req-d343cf60-09e1-4c78-89b3-120ea7370eda req-ff60eb1f-37dc-4555-be70-abfbade53b6c tempest-VolumesGetTestJSON-377498820 None] Lock "cinder-b750f6b2-8535-4a98-9a05-238370e20c06-delete_volume" released by "delete_volume" :: held 5.002s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:16 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 1.451s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9, size 1024.00 MB, duration 3.69 sec, destination /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.fbfda0ff-0dbe-4935-a496-12e972c101f1gcgw0ac3.img {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:17:16 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Converted 1024.00 MB image at 277.24 MB/s Apr 15 00:17:16 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] fbfda0ff-0dbe-4935-a496-12e972c101f1 was raw, no need to convert to raw {{(pid=83219) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Flow 'volume_create_manager' (1b16610c-84d3-43b4-b151-757cad5fe9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce11b85-761b-44bf-bb1e-e05a85266c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce11b85-761b-44bf-bb1e-e05a85266c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1333438198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e5625-64ca-43c5-8b08-166a11fc2e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211fa0f634a14df4bc8840aff732cc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:18Z,use_quota=True,user_id='554fa3e1b6694d47a3be2230b34c29b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac8d964-227f-4618-aadf-1684b75b16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac8d964-227f-4618-aadf-1684b75b16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a0c2c-e5e3-45d3-ad49-8e0215b3215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37a0c2c-e5e3-45d3-ad49-8e0215b3215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477e5625-64ca-43c5-8b08-166a11fc2e28', 'volume_name': 'volume-477e5625-64ca-43c5-8b08-166a11fc2e28', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af01ed-70b9-49bd-a39d-14118201c799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93af01ed-70b9-49bd-a39d-14118201c799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63eb10d-2fcf-428a-8fe4-49bd85ede81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:18 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Volume 477e5625-64ca-43c5-8b08-166a11fc2e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477e5625-64ca-43c5-8b08-166a11fc2e28', 'volume_size': 1} Apr 15 00:17:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:20 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-771370f8-20ba-4be4-be4d-fb8dd87f3440 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1597792908: creating Apr 15 00:17:20 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-771370f8-20ba-4be4-be4d-fb8dd87f3440 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1597792908: created successfully Apr 15 00:17:20 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-771370f8-20ba-4be4-be4d-fb8dd87f3440 tempest-GroupSnapshotsTest-1038558844 None] Create group completed successfully. Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (35669a7a-f7a3-49d8-ab63-9b523534e67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90db770f-2b2b-4ae3-8805-c15768736243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90db770f-2b2b-4ae3-8805-c15768736243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657629872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a13526b7-8eba-470a-9911-9c298d8ecafd,host='devstack@QuobyteHD#QuobyteHD',id=f50cf6ca-b755-4377-b665-f01487b1851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:22Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23a997de-a4c1-4b39-9f2a-1c2022dc6a7f),volume_type_id=23a997de-a4c1-4b39-9f2a-1c2022dc6a7f)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106a7fcd-6425-4ed9-8c63-f6d6fdae253f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106a7fcd-6425-4ed9-8c63-f6d6fdae253f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be68cb27-69b7-4c62-8ef0-2e318175f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be68cb27-69b7-4c62-8ef0-2e318175f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50cf6ca-b755-4377-b665-f01487b1851c', 'volume_name': 'volume-f50cf6ca-b755-4377-b665-f01487b1851c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7e5c3d-2280-4f36-85c9-1e7f46d1313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7e5c3d-2280-4f36-85c9-1e7f46d1313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73410a5-3d01-4e64-91da-88c864cbb05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Volume f50cf6ca-b755-4377-b665-f01487b1851c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50cf6ca-b755-4377-b665-f01487b1851c', 'volume_size': 1} Apr 15 00:17:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.850s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Uploaded volume to glance image-id: fbfda0ff-0dbe-4935-a496-12e972c101f1. {{(pid=83219) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.354s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1333438198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477e5625-64ca-43c5-8b08-166a11fc2e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='211fa0f634a14df4bc8840aff732cc0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:18Z,use_quota=True,user_id='554fa3e1b6694d47a3be2230b34c29b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Creating volume 477e5625-64ca-43c5-8b08-166a11fc2e28 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:31 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:31 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 1073741824 Apr 15 00:17:31 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d9cb5ea8-9ff1-454d-8d78-db59d818c23c tempest-VolumesActionsTest-250678551 None] Copy volume to image completed successfully. Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:31 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 1073741824" returned: 0 in 0.783s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:31 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 Apr 15 00:17:31 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:32 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.483s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a13526b7-8eba-470a-9911-9c298d8ecafd,created_at=2026-04-14T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657629872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a13526b7-8eba-470a-9911-9c298d8ecafd,host='devstack@QuobyteHD#QuobyteHD',id=f50cf6ca-b755-4377-b665-f01487b1851c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:22Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23a997de-a4c1-4b39-9f2a-1c2022dc6a7f),volume_type_id=23a997de-a4c1-4b39-9f2a-1c2022dc6a7f)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Creating volume f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:32 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63eb10d-2fcf-428a-8fe4-49bd85ede81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477e5625-64ca-43c5-8b08-166a11fc2e28', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5de8b0b-3d2d-40ea-a5ce-93f89015cabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:32 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c 1073741824 Apr 15 00:17:32 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:32 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Volume volume-477e5625-64ca-43c5-8b08-166a11fc2e28 (477e5625-64ca-43c5-8b08-166a11fc2e28): created successfully Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5de8b0b-3d2d-40ea-a5ce-93f89015cabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Flow 'volume_create_manager' (1b16610c-84d3-43b4-b151-757cad5fe9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:32 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ec744c04-7a61-4a8f-bfa1-34f5b731cdea tempest-ServerRescueNegativeTestJSON-841149131 None] Created volume successfully. Apr 15 00:17:33 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c 1073741824" returned: 0 in 0.780s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:33 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:17:33 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:33 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.779s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73410a5-3d01-4e64-91da-88c864cbb05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50cf6ca-b755-4377-b665-f01487b1851c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3838f98-73f5-4ff3-bb13-cea895fda9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9167a062-9290-4216-ae33-f12eb2fc2760]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:33 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Volume volume-f50cf6ca-b755-4377-b665-f01487b1851c (f50cf6ca-b755-4377-b665-f01487b1851c): created successfully Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3838f98-73f5-4ff3-bb13-cea895fda9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (35669a7a-f7a3-49d8-ab63-9b523534e67c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:33 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-52873c58-37d1-4c3c-825e-6ff8ba90194a tempest-GroupSnapshotsTest-1038558844 None] Created volume successfully. Apr 15 00:17:33 devstack sudo[87130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:33 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:34 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.681s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b488a7-d017-40ee-acd7-5aafd0115dfe]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] GroupSnapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: creating. Apr 15 00:17:34 devstack sudo[87135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:34 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Group snapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: creating. {{(pid=83219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:34 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.578s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:34 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img Apr 15 00:17:34 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:37 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img" returned: 0 in 2.977s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a486768-2ff0-47d3-8ede-360e6badf88b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:37 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:37 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:38 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.758s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:38 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9, size 1024.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:17:38 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Converted 1024.00 MB image at 343.85 MB/s Apr 15 00:17:38 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] 18fea233-8ae7-4254-99c5-2ebbf3aa2add was raw, converting to qcow2 {{(pid=83219) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 00:17:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d39b17-78d0-4816-ab39-9d03407be0ad]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:38 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img Apr 15 00:17:38 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:39 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:39 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img Apr 15 00:17:39 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:39 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img" returned: 1 in 0.525s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:17:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img /opt/stack/data/cinder/conversion/vol_upload_f6xkba27 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:39 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img /opt/stack/data/cinder/conversion/vol_upload_f6xkba27 Apr 15 00:17:39 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:40 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img /opt/stack/data/cinder/conversion/vol_upload_f6xkba27" returned: 0 in 0.592s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Image conversion details: src /opt/stack/data/cinder/conversion/c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9.temp_image.18fea233-8ae7-4254-99c5-2ebbf3aa2add0_8wx0x_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f6xkba27 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:17:40 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b57cfe-da58-49ff-a55a-450b78266552]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f6xkba27 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Acquiring lock "cinder-369cceb1-72f3-45ba-807a-bf628223dd6f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "cinder-369cceb1-72f3-45ba-807a-bf628223dd6f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:40 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f6xkba27 Apr 15 00:17:40 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Acquiring lock "cinder-quobyte-369cceb1-72f3-45ba-807a-bf628223dd6f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "cinder-quobyte-369cceb1-72f3-45ba-807a-bf628223dd6f" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c372ed2-2e2b-4464-9578-5ff38ae776cb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:40 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f Apr 15 00:17:40 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:40 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f6xkba27" returned: 0 in 0.509s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:41 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f" returned: 0 in 0.547s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:41 devstack sudo[87274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f Apr 15 00:17:41 devstack sudo[87274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:41 devstack sudo[87274]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-369cceb1-72f3-45ba-807a-bf628223dd6f" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "cinder-quobyte-369cceb1-72f3-45ba-807a-bf628223dd6f" released by "delete_volume" :: held 1.068s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Created reservations ['32674f33-13c0-4c78-bbc4-e24b77d27819', '070d0ec7-8ecd-4001-927a-4e9ac576b987', 'ec4bd058-e116-45d0-899a-96c1dd05a9fe', '537845ea-26fa-4e5e-8ce3-b3cc727bc2f1'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:41 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:41 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.346s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Uploaded volume to glance image-id: 18fea233-8ae7-4254-99c5-2ebbf3aa2add. {{(pid=83219) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.521s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Creating offline snapshot 33d69d86-d211-4aaa-a306-adc44e6f0ca6 of volume f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:17:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-dd312479-d1bd-43d7-8abd-4b5048c15658 tempest-VolumesActionsTest-250678551 None] Copy volume to image completed successfully. Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ac3445-311d-4a2f-af13-9364a3a1e6a5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:42 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:17:42 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:42 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:42 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:42 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.223s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Deleted volume successfully. Apr 15 00:17:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aad05f5a-5c5f-4efc-9917-ecede26a8051 tempest-VolumesNegativeTest-1387398379 None] Lock "cinder-369cceb1-72f3-45ba-807a-bf628223dd6f-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Acquiring lock "cinder-quobyte-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "cinder-quobyte-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" acquired by "delete_volume" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[510b3dff-2a1b-4c5f-80f3-c364c79f0cc5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:43 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:43 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:43 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 1.520s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:43 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 1G Apr 15 00:17:43 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:43 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.368s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:43 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:44 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 1.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:44 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9 Apr 15 00:17:44 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:44 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 1G" returned: 0 in 1.216s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50cf6ca-b755-4377-b665-f01487b1851c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:44 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50cf6ca-b755-4377-b665-f01487b1851c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:17:44 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:45 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50cf6ca-b755-4377-b665-f01487b1851c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 0.658s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:45 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:45 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:17:45 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:45 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" returned: 0 in 0.804s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "cinder-quobyte-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9" released by "delete_volume" :: held 2.335s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Created reservations ['5a0dadf8-8b90-4227-a2c8-3b264943e451', '94954c1d-1b10-4cc4-98df-c92f3d1e6ed0', 'f2598b6d-de8e-46b3-b0dd-1befc334f3c5', '2d112e1e-8825-449e-b92f-c54c8b214505'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:45 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:45 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:46 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 1.136s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:46 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.977s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:46 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Deleted volume successfully. Apr 15 00:17:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e9db26b1-7b44-4036-ae1d-4b70775bfeba tempest-VolumesActionsTest-250678551 None] Lock "cinder-c3b31a2f-6c1f-427f-b9b2-a55d6a236fe9-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:46 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info Apr 15 00:17:46 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:47 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info" returned: 0 in 0.645s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:47 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:17:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:47 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info Apr 15 00:17:47 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:47 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.info" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.767s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a51a61be-bc56-4dd1-8928-7b04f82d7305 tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: created successfully Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6-9368a250-dd51-4144-b147-9b539c12b95e" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6-9368a250-dd51-4144-b147-9b539c12b95e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Creating volume 9368a250-dd51-4144-b147-9b539c12b95e from snapshot 33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] snapshot: 33d69d86-d211-4aaa-a306-adc44e6f0ca6, volume: 9368a250-dd51-4144-b147-9b539c12b95e, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc00d76-3eea-443a-b4cb-507eb96dac92]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:49 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:17:49 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:50 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 0.820s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50cf6ca-b755-4377-b665-f01487b1851c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e667a40-5787-4564-a2c5-4c61be67b5cc]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:50 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:17:50 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Acquiring lock "cinder-477e5625-64ca-43c5-8b08-166a11fc2e28-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "cinder-477e5625-64ca-43c5-8b08-166a11fc2e28-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Acquiring lock "cinder-quobyte-477e5625-64ca-43c5-8b08-166a11fc2e28" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "cinder-quobyte-477e5625-64ca-43c5-8b08-166a11fc2e28" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a48b681-bd1f-427b-a01d-5825e78bd341]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:51 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 0.865s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:17:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:51 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 Apr 15 00:17:51 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:51 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e Apr 15 00:17:51 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:52 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28" returned: 0 in 0.686s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:52 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28 Apr 15 00:17:52 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:53 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477e5625-64ca-43c5-8b08-166a11fc2e28" returned: 0 in 1.713s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "cinder-quobyte-477e5625-64ca-43c5-8b08-166a11fc2e28" released by "delete_volume" :: held 2.443s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:53 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Created reservations ['67540f8e-5795-4eca-9b71-57ac3fd40455', '08e94b87-b96b-4bf1-82a2-1ce97bc15de2', '5e023fdf-9c56-413e-a00d-35aea78db8dc', 'c6ef59ef-2346-4570-9b33-4b9163259aad'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:54 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:54 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:54 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e" returned: 0 in 3.175s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb5d4a-c3f3-484d-bcb3-0ad33cc75f5c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:54 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:17:54 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Flow 'volume_create_manager' (7ab94483-c8f5-42f5-a57e-531487e1997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de39a0d-169f-4f9a-8689-3c9aeb6baa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de39a0d-169f-4f9a-8689-3c9aeb6baa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-595570926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd42ca9f-a0af-4238-a8ae-f796d093b727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15b7e8f736b44f25879f0da1c4da1b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:55Z,use_quota=True,user_id='231e4dc8869446698574a12f7b159145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdffb4-1de6-4af8-b65c-0332fddba696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71bdffb4-1de6-4af8-b65c-0332fddba696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dc109c-b2f9-4a17-90d5-c741df2399c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dc109c-b2f9-4a17-90d5-c741df2399c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd42ca9f-a0af-4238-a8ae-f796d093b727', 'volume_name': 'volume-dd42ca9f-a0af-4238-a8ae-f796d093b727', 'volume_size': 2}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a28fcb8-082a-4d2b-bdf5-ed92af29a630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a28fcb8-082a-4d2b-bdf5-ed92af29a630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab4284c-78b5-4a91-ad69-794139881674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:55 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Volume dd42ca9f-a0af-4238-a8ae-f796d093b727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd42ca9f-a0af-4238-a8ae-f796d093b727', 'volume_size': 2} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:55 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.127s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:55 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Deleted volume successfully. Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6adf3d7a-033d-4e18-b149-b63f97c206d2 tempest-ServerRescueNegativeTestJSON-841149131 None] Lock "cinder-477e5625-64ca-43c5-8b08-166a11fc2e28-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:55 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 1.083s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c, size 1024.00 MB, duration 3.18 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:17:55 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Converted 1024.00 MB image at 322.30 MB/s Apr 15 00:17:55 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:17:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:55 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e Apr 15 00:17:55 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:56 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e" returned: 0 in 0.675s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" released by "_copy_volume_from_snapshot" :: held 6.712s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6-9368a250-dd51-4144-b147-9b539c12b95e" released by "_create_volume_from_snapshot" :: held 6.741s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.763s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-595570926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd42ca9f-a0af-4238-a8ae-f796d093b727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15b7e8f736b44f25879f0da1c4da1b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:17:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:17:55Z,use_quota=True,user_id='231e4dc8869446698574a12f7b159145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Creating volume dd42ca9f-a0af-4238-a8ae-f796d093b727 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:56 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 2147483648 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:56 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 2147483648 Apr 15 00:17:56 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b64b0b18-abaf-40a9-81ad-6d9bb6e77a89 tempest-GroupSnapshotsTest-1038558844 None] Create group from source-snapshot-1c767dc2-a133-4356-86d8-02cc0aab93f9 completed successfully. Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe224ea3-f8fd-43a7-911b-cb9b71db8b5c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:57 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 2147483648" returned: 0 in 0.898s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:57 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 Apr 15 00:17:57 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:57 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e Apr 15 00:17:57 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:58 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e" returned: 0 in 0.753s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:58 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727" returned: 0 in 0.724s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:58 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e Apr 15 00:17:58 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eab4284c-78b5-4a91-ad69-794139881674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd42ca9f-a0af-4238-a8ae-f796d093b727', 'volume_size': 2}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fb6b0c-5537-4164-a040-0005f4699a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:58 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Volume volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 (dd42ca9f-a0af-4238-a8ae-f796d093b727): created successfully Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fb6b0c-5537-4164-a040-0005f4699a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Flow 'volume_create_manager' (7ab94483-c8f5-42f5-a57e-531487e1997e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:58 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e9caeef6-a98f-4740-9b4e-9ad158439e62 tempest-VolumesCloneNegativeTest-1296373562 None] Created volume successfully. Apr 15 00:17:58 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9368a250-dd51-4144-b147-9b539c12b95e" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9368a250-dd51-4144-b147-9b539c12b95e" released by "delete_volume" :: held 1.313s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['c5b60dce-99f2-4aca-8a08-895f2b392460'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:58 devstack cinder-volume[83219]: WARNING cinder.quota [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-162582462 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-162582462, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:17:58 devstack cinder-volume[83219]: WARNING cinder.quota [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-162582462 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-162582462, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['423e24a4-c961-429d-bdd6-4d0df0dabba9', 'bd59d6ff-e120-47b4-ab02-5e291626ca9a', '7d65dcd1-8878-45fd-a7c1-256ec386700f', 'b3bec422-0422-42ac-aafc-72150960969f'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:58 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:17:58 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:59 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.552s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:17:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-47897130-6f96-48cb-9243-70f831fbd820 tempest-GroupSnapshotsTest-1038558844 None] Delete group completed successfully. Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Acquiring lock "cinder-dd42ca9f-a0af-4238-a8ae-f796d093b727-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "cinder-dd42ca9f-a0af-4238-a8ae-f796d093b727-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Acquiring lock "cinder-quobyte-dd42ca9f-a0af-4238-a8ae-f796d093b727" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "cinder-quobyte-dd42ca9f-a0af-4238-a8ae-f796d093b727" acquired by "delete_volume" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f97a4-a9f0-40f9-8a07-34e88b8d8ca1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (0f171021-eb31-4c66-b7d2-a4f7fa78c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fe9c42-d76c-4561-938b-3d88d2c2c097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:59 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 Apr 15 00:17:59 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: deleting Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fe9c42-d76c-4561-938b-3d88d2c2c097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-987067164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d46471-0301-4d7e-ab3c-c21613946c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:00Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3a7872-0629-4969-9e69-25b1297bd40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3a7872-0629-4969-9e69-25b1297bd40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6d4f6d-51fc-4a72-bd47-6210c345be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6d4f6d-51fc-4a72-bd47-6210c345be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d46471-0301-4d7e-ab3c-c21613946c14', 'volume_name': 'volume-77d46471-0301-4d7e-ab3c-c21613946c14', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d1ed4-523f-4a28-be2b-d510bb5ca844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d1ed4-523f-4a28-be2b-d510bb5ca844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0734cab4-ee77-4dd4-94b7-8a88f1939a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:17:59 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Volume 77d46471-0301-4d7e-ab3c-c21613946c14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d46471-0301-4d7e-ab3c-c21613946c14', 'volume_size': 1} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-987067164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d46471-0301-4d7e-ab3c-c21613946c14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:00Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Creating volume 77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:17:59 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:59 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 1073741824 Apr 15 00:17:59 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: deleting {{(pid=83219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Deleting offline snapshot 33d69d86-d211-4aaa-a306-adc44e6f0ca6 of volume f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] snapshot_file for this snap is: volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c92e39-8958-4e88-8f02-10024f9f4ccc]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:17:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:17:59 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:17:59 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:00 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727" returned: 0 in 0.557s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:00 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727 Apr 15 00:18:00 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:00 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 1073741824" returned: 0 in 0.580s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:00 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 Apr 15 00:18:00 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:00 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 0.566s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50cf6ca-b755-4377-b665-f01487b1851c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed1c017-3703-49dd-a98c-c77bc05e89c5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:00 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:18:00 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:00 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-dd42ca9f-a0af-4238-a8ae-f796d093b727" returned: 0 in 0.526s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "cinder-quobyte-dd42ca9f-a0af-4238-a8ae-f796d093b727" released by "delete_volume" :: held 1.134s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Created reservations ['292c9187-53ea-43f8-8045-7e065c7341dd', 'b31edeb8-8da1-47f6-93be-1afad48b8d9d', '1f4401d1-f6ec-4495-a4e9-3408421c58fd', '52da2b16-b72d-4497-bb85-264889484d2b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:00 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:00 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:00 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14" returned: 0 in 0.535s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0734cab4-ee77-4dd4-94b7-8a88f1939a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d46471-0301-4d7e-ab3c-c21613946c14', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9403ca5f-a6b5-42de-ac43-c2243016520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:00 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Volume volume-77d46471-0301-4d7e-ab3c-c21613946c14 (77d46471-0301-4d7e-ab3c-c21613946c14): created successfully Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9403ca5f-a6b5-42de-ac43-c2243016520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (0f171021-eb31-4c66-b7d2-a4f7fa78c52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:00 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c962b8e5-f0a5-4179-981d-3bdc1ba80fa7 tempest-VolumesSnapshotTestJSON-343923192 None] Created volume successfully. Apr 15 00:18:01 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 0.558s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:01 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:18:01 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:01 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Deleted volume successfully. Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-46206ba4-3f6b-4cb6-aa60-65d5a8e90d2f tempest-VolumesCloneNegativeTest-1296373562 None] Lock "cinder-dd42ca9f-a0af-4238-a8ae-f796d093b727-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:01 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:01 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6 Apr 15 00:18:01 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=90,cinder:INSERT=22,cinder:UPDATE=102,cinder:DELETE=6 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Creating offline snapshot d2868854-0a32-43ea-bdd5-7716062710e8 of volume 77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c766b0-3512-44fa-ab35-98956d3c9180]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:02 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c.33d69d86-d211-4aaa-a306-adc44e6f0ca6" returned: 0 in 0.661s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-33d69d86-d211-4aaa-a306-adc44e6f0ca6" released by "_delete_snapshot" :: held 2.313s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" released by "delete_snapshot" :: held 2.324s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:02 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 Apr 15 00:18:02 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:02 devstack cinder-volume[83219]: WARNING cinder.quota [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-162582462 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-162582462, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['edf04d4f-8f3e-4faf-b902-1d594c520cca', 'febd33f7-69e8-4d5c-9064-59437f02761c', 'd2de04fa-719a-43b8-b857-0d63332280e4', '534f9e89-3a26-4da0-a542-729f83e26279'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-828d4806-926b-456e-bf4e-206d1cac293b tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1c767dc2-a133-4356-86d8-02cc0aab93f9: deleted successfully Apr 15 00:18:02 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14" returned: 0 in 0.641s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:02 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 1G Apr 15 00:18:02 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[97459d93-0130-4669-98df-94c5eb8e7d11]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:03 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:18:03 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:03 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 1G" returned: 0 in 0.536s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d46471-0301-4d7e-ab3c-c21613946c14 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:03 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d46471-0301-4d7e-ab3c-c21613946c14 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 Apr 15 00:18:03 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:03 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 0.564s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:03 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c Apr 15 00:18:03 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:03 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77d46471-0301-4d7e-ab3c-c21613946c14 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:03 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 is being set with open permissions: ugo+rw Apr 15 00:18:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:03 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 Apr 15 00:18:03 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:04 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f50cf6ca-b755-4377-b665-f01487b1851c" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-f50cf6ca-b755-4377-b665-f01487b1851c" released by "delete_volume" :: held 1.076s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['8eabc62c-6c6e-4ff6-8c40-d4e74e48f3de'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:04 devstack cinder-volume[83219]: WARNING cinder.db.sqlalchemy.api [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-162582462'] Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['712ddf34-eead-417b-b771-99104983baf1', '38909e92-f738-4861-ac5f-042dbc0025a8', 'd3fd077f-0c47-45ec-9d0c-495481780399', '8edd71d2-c35e-4f89-b395-f809a969a043'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:04 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8" returned: 0 in 0.585s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:04 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info Apr 15 00:18:04 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:04 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:04 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:04 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info" returned: 0 in 0.571s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:04 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info is being set with open permissions: ugo+rw Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:04 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info Apr 15 00:18:04 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:04 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.529s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:04 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:04 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0e3e4184-2f8e-47b5-9986-0b5b23f4a5ba tempest-GroupSnapshotsTest-1038558844 None] Delete group completed successfully. Apr 15 00:18:05 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.info" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.312s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c35446ce-2032-4482-81f7-11f6ef3f52cf tempest-VolumesSnapshotTestJSON-343923192 None] Create snapshot completed successfully Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-326cf298-1136-407a-b11e-857d02f82ad4 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1167959651: creating Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-326cf298-1136-407a-b11e-857d02f82ad4 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1167959651: created successfully Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-326cf298-1136-407a-b11e-857d02f82ad4 tempest-GroupSnapshotsTest-1038558844 None] Create group completed successfully. Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (5ea12b20-f83a-4263-9abb-c6174dea9851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd3841-d5e5-428d-9f4d-359f6ff07a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bd3841-d5e5-428d-9f4d-359f6ff07a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1498744646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de47d024-4a82-4c6a-b31c-eb58d6b74565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:06Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a387fe9-fc36-4c8e-a95e-142ccf571037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a387fe9-fc36-4c8e-a95e-142ccf571037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1f0bd7-2b44-4ca8-9aa8-bfa438f860d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1f0bd7-2b44-4ca8-9aa8-bfa438f860d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de47d024-4a82-4c6a-b31c-eb58d6b74565', 'volume_name': 'volume-de47d024-4a82-4c6a-b31c-eb58d6b74565', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72cb8da-26ef-4b0c-925d-776b3a50a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72cb8da-26ef-4b0c-925d-776b3a50a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7472a5eb-62c0-44d3-9870-38245757bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume de47d024-4a82-4c6a-b31c-eb58d6b74565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de47d024-4a82-4c6a-b31c-eb58d6b74565', 'volume_size': 1} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1498744646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de47d024-4a82-4c6a-b31c-eb58d6b74565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:06Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:05 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:05 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 1073741824 Apr 15 00:18:05 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:06 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 1073741824" returned: 0 in 0.507s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:06 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 Apr 15 00:18:06 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-d2868854-0a32-43ea-bdd5-7716062710e8-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-d2868854-0a32-43ea-bdd5-7716062710e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-d2868854-0a32-43ea-bdd5-7716062710e8" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-d2868854-0a32-43ea-bdd5-7716062710e8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Deleting offline snapshot d2868854-0a32-43ea-bdd5-7716062710e8 of volume 77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] snapshot_file for this snap is: volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c425ef-3cc5-4bf6-8591-7adf14f1059d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:06 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 Apr 15 00:18:06 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:06 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7472a5eb-62c0-44d3-9870-38245757bef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de47d024-4a82-4c6a-b31c-eb58d6b74565', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfe7181-3eea-4389-8361-534395382ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 (de47d024-4a82-4c6a-b31c-eb58d6b74565): created successfully Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfe7181-3eea-4389-8361-534395382ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (5ea12b20-f83a-4263-9abb-c6174dea9851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a2f98cc9-372a-469b-9aff-f52afeeeb9b1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (8da4c3d0-640d-48cf-acfc-af0274a2949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c98ab-8a86-4330-bb54-30bff4e22760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (341c98ab-8a86-4330-bb54-30bff4e22760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276257340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,host='devstack@QuobyteHD#QuobyteHD',id=22b80866-92cd-47c9-94d4-9b91fd62dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:07Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd8c014-f5f4-439a-8e34-d1933a064b79),volume_type_id=7cd8c014-f5f4-439a-8e34-d1933a064b79)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d84549a-dcfc-4c65-884f-0f0d8d2c7d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d84549a-dcfc-4c65-884f-0f0d8d2c7d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd389b8-1ffb-40a7-9c72-fd0bb4777e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdd389b8-1ffb-40a7-9c72-fd0bb4777e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b80866-92cd-47c9-94d4-9b91fd62dea0', 'volume_name': 'volume-22b80866-92cd-47c9-94d4-9b91fd62dea0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743c4e5-d28a-4522-846f-f5a87998ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743c4e5-d28a-4522-846f-f5a87998ba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322ec2d5-2e6f-447f-b29a-86d8a6dea8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Volume 22b80866-92cd-47c9-94d4-9b91fd62dea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b80866-92cd-47c9-94d4-9b91fd62dea0', 'volume_size': 1} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,created_at=2026-04-14T22:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276257340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,host='devstack@QuobyteHD#QuobyteHD',id=22b80866-92cd-47c9-94d4-9b91fd62dea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:07Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd8c014-f5f4-439a-8e34-d1933a064b79),volume_type_id=7cd8c014-f5f4-439a-8e34-d1933a064b79)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Creating volume 22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:06 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:06 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8" returned: 0 in 0.579s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77d46471-0301-4d7e-ab3c-c21613946c14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:06 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 1073741824 Apr 15 00:18:06 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3966c-dfc0-44fc-b7aa-39df77d511d4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:07 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 Apr 15 00:18:07 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:07 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 1073741824" returned: 0 in 0.515s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:07 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14" returned: 0 in 0.492s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:07 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 Apr 15 00:18:07 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:07 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 Apr 15 00:18:07 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:07 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:07 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:08 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8 Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322ec2d5-2e6f-447f-b29a-86d8a6dea8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b80866-92cd-47c9-94d4-9b91fd62dea0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:08 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252db23d-c304-4792-b87f-fe0fa378129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating offline snapshot b21334a2-bfa9-4f5a-9f6c-acf0104abae2 of volume de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Volume volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 (22b80866-92cd-47c9-94d4-9b91fd62dea0): created successfully Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252db23d-c304-4792-b87f-fe0fa378129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (8da4c3d0-640d-48cf-acfc-af0274a2949b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af514c-177a-422e-b613-3504ba658723]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:08 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4fdfb2f9-b882-4a30-b05f-fe3251bcea03 tempest-GroupSnapshotsTest-1038558844 None] Created volume successfully. Apr 15 00:18:08 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 Apr 15 00:18:08 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:08 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14.d2868854-0a32-43ea-bdd5-7716062710e8" returned: 0 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-d2868854-0a32-43ea-bdd5-7716062710e8" released by "_delete_snapshot" :: held 2.091s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" released by "delete_snapshot" :: held 2.100s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['06d13da7-f331-40ee-98ec-1e91c761fc69', '4e69be0e-a6da-4663-a529-24d3575eb874', '0500acd3-7bde-4006-9cc2-e9f2e99469a2', '3daab14f-e9a2-4644-b5e8-66fad759f6d1'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:08 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Delete snapshot completed successfully. Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2cbc4112-21dd-4d72-acfa-560ad015d5de tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-d2868854-0a32-43ea-bdd5-7716062710e8-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:08 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:08 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 1G Apr 15 00:18:08 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:09 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 1G" returned: 0 in 0.537s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:09 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 Apr 15 00:18:09 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (572e68b0-9160-4045-9048-7697e6ccc580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d72bf49-dd7c-4067-a035-dd12e992da92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d72bf49-dd7c-4067-a035-dd12e992da92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287556265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,host='devstack@QuobyteHD#QuobyteHD',id=9b2d1793-34a2-4d46-bc6f-f6e2a046f77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:09Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd8c014-f5f4-439a-8e34-d1933a064b79),volume_type_id=7cd8c014-f5f4-439a-8e34-d1933a064b79)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e2914-933c-467a-95c7-0a2d26ba5c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283e2914-933c-467a-95c7-0a2d26ba5c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48849bf5-fa03-40f1-a0af-93aa8655c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48849bf5-fa03-40f1-a0af-93aa8655c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2d1793-34a2-4d46-bc6f-f6e2a046f77a', 'volume_name': 'volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbbb577-88b7-4c84-9867-0b447f86fe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbbb577-88b7-4c84-9867-0b447f86fe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02991493-6412-4692-bc05-1fcda0e50fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Volume 9b2d1793-34a2-4d46-bc6f-f6e2a046f77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a', 'volume_size': 1} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:09 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2" returned: 0 in 0.560s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:09 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 is being set with open permissions: ugo+rw Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:09 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 Apr 15 00:18:09 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (91a040dd-b9a0-4468-8510-4dfed3ca7dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92523f-496e-407d-83cb-3fd07b83072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d92523f-496e-407d-83cb-3fd07b83072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774204427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6c3221-6ebd-4c5c-b68a-3b406851d194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:10Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8ed071-e38a-42f4-a108-d73056472cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8ed071-e38a-42f4-a108-d73056472cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ff3d76-31da-4584-b540-e1591c27a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ff3d76-31da-4584-b540-e1591c27a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b6c3221-6ebd-4c5c-b68a-3b406851d194', 'volume_name': 'volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9905fd64-1dff-4bec-b506-f985d482c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9905fd64-1dff-4bec-b506-f985d482c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4551b6a2-d578-42df-8c15-7166fa21720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Volume 4b6c3221-6ebd-4c5c-b68a-3b406851d194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194', 'volume_size': 1} Apr 15 00:18:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:10 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:10 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info Apr 15 00:18:10 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:10 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:10 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info is being set with open permissions: ugo+rw Apr 15 00:18:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:10 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info Apr 15 00:18:10 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:11 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.info" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.690s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,created_at=2026-04-14T22:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1287556265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecd8f42c-3e2a-4197-9dc1-5979963f2a0a,host='devstack@QuobyteHD#QuobyteHD',id=9b2d1793-34a2-4d46-bc6f-f6e2a046f77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:09Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7cd8c014-f5f4-439a-8e34-d1933a064b79),volume_type_id=7cd8c014-f5f4-439a-8e34-d1933a064b79)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Creating volume 9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:11 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:11 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a 1073741824 Apr 15 00:18:11 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1a905b94-868f-4e02-978c-a3f9b0bef2de tempest-CreateVolumesFromSnapshotTest-892128842 None] Create snapshot completed successfully Apr 15 00:18:11 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a 1073741824" returned: 0 in 0.499s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:11 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a Apr 15 00:18:11 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:12 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.322s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774204427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b6c3221-6ebd-4c5c-b68a-3b406851d194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:10Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Creating volume 4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02991493-6412-4692-bc05-1fcda0e50fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 1073741824 Apr 15 00:18:12 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40af7d2f-2c4b-4a39-9583-1276653b2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Volume volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a (9b2d1793-34a2-4d46-bc6f-f6e2a046f77a): created successfully Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40af7d2f-2c4b-4a39-9583-1276653b2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (572e68b0-9160-4045-9048-7697e6ccc580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-3ed0851f-0901-427c-a0c3-47a28e9ab596 tempest-GroupSnapshotsTest-1038558844 None] Created volume successfully. Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (f7eb0c56-2e06-44ce-b94d-6537c716f0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c77cac1-986c-4609-bfa9-37df4c8d3747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c77cac1-986c-4609-bfa9-37df4c8d3747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957286542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a9cccc-3e8d-4225-a77f-91418fce83a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:12Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a997038-bf9b-402c-a848-d717ee72de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a997038-bf9b-402c-a848-d717ee72de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5cd02-b512-4522-980d-e720ab1bfa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5cd02-b512-4522-980d-e720ab1bfa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a9cccc-3e8d-4225-a77f-91418fce83a7', 'volume_name': 'volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3927e556-2687-4aef-9fef-46ff3e40cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3927e556-2687-4aef-9fef-46ff3e40cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad1ebb9-18dd-4f63-9d1e-157cf2e5bede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume c6a9cccc-3e8d-4225-a77f-91418fce83a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7', 'volume_size': 1} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (34a81190-b79c-4d86-aa31-f03b41bf9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77b8d1c-0417-4cb9-bfb7-fde3493a20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77b8d1c-0417-4cb9-bfb7-fde3493a20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-90780395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca37d6-3164-4f75-a152-6403d8c86a2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0861abfd-d5e5-4ec7-863d-fac7a3cf8805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0861abfd-d5e5-4ec7-863d-fac7a3cf8805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e714e92-1f32-4291-b3b6-ce91c5bf67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e714e92-1f32-4291-b3b6-ce91c5bf67e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ca37d6-3164-4f75-a152-6403d8c86a2f', 'volume_name': 'volume-96ca37d6-3164-4f75-a152-6403d8c86a2f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069a4cfc-ebbd-4321-8a25-2ec1f8110586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (069a4cfc-ebbd-4321-8a25-2ec1f8110586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe0139-0fb5-43ba-9243-ae04eb68952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Volume 96ca37d6-3164-4f75-a152-6403d8c86a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ca37d6-3164-4f75-a152-6403d8c86a2f', 'volume_size': 1} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (94117559-5b14-4db5-92ca-94b61c062fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85266368-d694-49aa-8fb1-263a3a9a8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 1073741824" returned: 0 in 0.660s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85266368-d694-49aa-8fb1-263a3a9a8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311447823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc61e67-ff86-4861-bec8-e9df478bf246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc61e67-ff86-4861-bec8-e9df478bf246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b13854b-0ffc-405c-9f5e-01845608b9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b13854b-0ffc-405c-9f5e-01845608b9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e', 'volume_name': 'volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629c655e-5fe3-43a8-8c08-087ad19bda31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629c655e-5fe3-43a8-8c08-087ad19bda31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b34ae-c049-4a15-a086-a089ae6b0815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e', 'volume_size': 1} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6c2224f4-175f-472d-a3b2-a14f568df881 tempest-GroupSnapshotsTest-1038558844 None] Update group completed successfully. Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:12 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:12 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (e4c8eb86-6887-47eb-9ec6-91248afb256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993205f3-df2d-4de1-81db-62c7bc03ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993205f3-df2d-4de1-81db-62c7bc03ac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541809429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dd77d4-f88c-4067-b63d-6ca23b82ea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95a5265-359b-44ac-82f5-22d399403ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95a5265-359b-44ac-82f5-22d399403ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a112172-6217-4131-b693-fb73d7ef461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a112172-6217-4131-b693-fb73d7ef461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5dd77d4-f88c-4067-b63d-6ca23b82ea0a', 'volume_name': 'volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de83558f-8a39-44f1-a9ba-45fbbf775cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de83558f-8a39-44f1-a9ba-45fbbf775cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91473f9c-15c7-4cff-82a0-91e5de56ccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume f5dd77d4-f88c-4067-b63d-6ca23b82ea0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a', 'volume_size': 1} Apr 15 00:18:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (1eea0e5e-4441-452f-8b57-dd063268f667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e54f4-a833-4ffd-a947-23661519c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e54f4-a833-4ffd-a947-23661519c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950412021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fffd0b-f967-4823-938c-8c4d531f1eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92497c8c-f76d-4a6e-90a6-9ba80f264edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92497c8c-f76d-4a6e-90a6-9ba80f264edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5af8dd-b803-491c-9856-49d8318a48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e5af8dd-b803-491c-9856-49d8318a48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fffd0b-f967-4823-938c-8c4d531f1eec', 'volume_name': 'volume-59fffd0b-f967-4823-938c-8c4d531f1eec', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a2457c-b62a-4533-a286-7f3a84bf0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a2457c-b62a-4533-a286-7f3a84bf0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28666ae9-6348-4bfa-885a-76be0a4ac3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume 59fffd0b-f967-4823-938c-8c4d531f1eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fffd0b-f967-4823-938c-8c4d531f1eec', 'volume_size': 1} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (8ac8405c-f8e4-4e2b-b986-6d18d4aa1570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fd5e50-26bc-452e-aa7e-30d3fe2e6ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fd5e50-26bc-452e-aa7e-30d3fe2e6ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857775499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a9c625-9833-4c34-8152-55be993b201a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7018a3-173e-49dd-ba21-88630754ea61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a7018a3-173e-49dd-ba21-88630754ea61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb69461-bb76-4cd4-841f-4c139c9b59e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb69461-bb76-4cd4-841f-4c139c9b59e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a9c625-9833-4c34-8152-55be993b201a', 'volume_name': 'volume-19a9c625-9833-4c34-8152-55be993b201a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f141b9-d8d5-4635-836f-a985578b0076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f141b9-d8d5-4635-836f-a985578b0076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbbb5b-e002-49a3-aaeb-9111aeaf71e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume 19a9c625-9833-4c34-8152-55be993b201a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a9c625-9833-4c34-8152-55be993b201a', 'volume_size': 1} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:13 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1957286542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a9cccc-3e8d-4225-a77f-91418fce83a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:12Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume c6a9cccc-3e8d-4225-a77f-91418fce83a7 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4551b6a2-d578-42df-8c15-7166fa21720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 1073741824 Apr 15 00:18:13 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a61d789-7d99-4bdd-8ea2-9522019013c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Volume volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 (4b6c3221-6ebd-4c5c-b68a-3b406851d194): created successfully Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a61d789-7d99-4bdd-8ea2-9522019013c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (91a040dd-b9a0-4468-8510-4dfed3ca7dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b218be8f-04d1-4a60-94b0-4cb2f52da906 tempest-VolumesSnapshotTestJSON-343923192 None] Created volume successfully. Apr 15 00:18:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-aa0aec84-2d38-451f-bcda-c55a2c503d91 tempest-GroupSnapshotsTest-1038558844 None] Update group completed successfully. Apr 15 00:18:13 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 1073741824" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:13 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 Apr 15 00:18:13 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:14 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7" returned: 0 in 0.454s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-90780395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ca37d6-3164-4f75-a152-6403d8c86a2f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Creating volume 96ca37d6-3164-4f75-a152-6403d8c86a2f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:14 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad1ebb9-18dd-4f63-9d1e-157cf2e5bede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733917d-6209-457e-88d1-c2ee54902bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:14 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f 1073741824 Apr 15 00:18:14 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:14 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 (c6a9cccc-3e8d-4225-a77f-91418fce83a7): created successfully Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733917d-6209-457e-88d1-c2ee54902bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (f7eb0c56-2e06-44ce-b94d-6537c716f0f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ff78e73d-1dd6-487a-8ae5-4b27d5a182c2 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:14 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f 1073741824" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:14 devstack sudo[87693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f Apr 15 00:18:14 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-08767e86-fd7b-44e8-a1e8-43c31d679914 tempest-GroupSnapshotsTest-1038558844 None] Update group completed successfully. Apr 15 00:18:15 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f" returned: 0 in 0.428s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-311447823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:15 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe0139-0fb5-43ba-9243-ae04eb68952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ca37d6-3164-4f75-a152-6403d8c86a2f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:15 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e 1073741824 Apr 15 00:18:15 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aede8b94-82a6-49a2-ac46-4ebaff7927e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:15 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Volume volume-96ca37d6-3164-4f75-a152-6403d8c86a2f (96ca37d6-3164-4f75-a152-6403d8c86a2f): created successfully Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aede8b94-82a6-49a2-ac46-4ebaff7927e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (34a81190-b79c-4d86-aa31-f03b41bf9d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:15 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b752f0cc-74f8-44f3-9467-2d68a25ff34c tempest-VolumesTestJSON-1791804397 None] Created volume successfully. Apr 15 00:18:15 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e 1073741824" returned: 0 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:15 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e Apr 15 00:18:15 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (990e0f85-7cd5-43dd-8d56-dc3f856990e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c06415-a203-45fb-bcc4-95279a0d7a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c06415-a203-45fb-bcc4-95279a0d7a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770541209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:16Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89ad8be-f208-4162-ad33-31a73acb7514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89ad8be-f208-4162-ad33-31a73acb7514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb37769-3f0e-405d-b2f8-05c0a45a7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb37769-3f0e-405d-b2f8-05c0a45a7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a', 'volume_name': 'volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f707c63-ea6a-403d-9aba-6bf412b17604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f707c63-ea6a-403d-9aba-6bf412b17604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6add8a3-2366-48a7-ade2-ae93ea0e5334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Volume 13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a', 'volume_size': 1} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4720a9f8-18cd-4acd-a9f6-41640adc5cb6 tempest-GroupSnapshotsTest-1038558844 None] Update group completed successfully. Apr 15 00:18:16 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" returned: 0 in 0.468s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.254s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541809429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5dd77d4-f88c-4067-b63d-6ca23b82ea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume f5dd77d4-f88c-4067-b63d-6ca23b82ea0a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:16 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964b34ae-c049-4a15-a086-a089ae6b0815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a 1073741824 Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ccec0-0937-48ef-83d3-ea54399e7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:16 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e (b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e): created successfully Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ccec0-0937-48ef-83d3-ea54399e7534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (94117559-5b14-4db5-92ca-94b61c062fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ad175a72-70e9-4147-97be-106812889d0c tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:16 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a 1073741824" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:16 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a Apr 15 00:18:16 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:17 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" returned: 0 in 0.423s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.995s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-950412021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fffd0b-f967-4823-938c-8c4d531f1eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume 59fffd0b-f967-4823-938c-8c4d531f1eec {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:17 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91473f9c-15c7-4cff-82a0-91e5de56ccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:17 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec 1073741824 Apr 15 00:18:17 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ae59dd-075e-476b-afe0-d972fa322ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:17 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a (f5dd77d4-f88c-4067-b63d-6ca23b82ea0a): created successfully Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ae59dd-075e-476b-afe0-d972fa322ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (e4c8eb86-6887-47eb-9ec6-91248afb256e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:17 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2085425e-fca9-48ea-9749-4eb73c373ca0 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:17 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] GroupSnapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: creating. Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Group snapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: creating. {{(pid=83219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:17 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec 1073741824" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:17 devstack sudo[87720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec Apr 15 00:18:17 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:18 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.802s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857775499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a9c625-9833-4c34-8152-55be993b201a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86ba3fffb7f04f4a8cfcc42b888e957b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:13Z,use_quota=True,user_id='cd6efb601be045d5a8ee0008285a1ceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Creating volume 19a9c625-9833-4c34-8152-55be993b201a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:18 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28666ae9-6348-4bfa-885a-76be0a4ac3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fffd0b-f967-4823-938c-8c4d531f1eec', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa05ba31-4aac-4dd6-a926-5e121f6f5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:18 devstack sudo[87723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a 1073741824 Apr 15 00:18:18 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:18 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-59fffd0b-f967-4823-938c-8c4d531f1eec (59fffd0b-f967-4823-938c-8c4d531f1eec): created successfully Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa05ba31-4aac-4dd6-a926-5e121f6f5995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (1eea0e5e-4441-452f-8b57-dd063268f667) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bd29221f-6386-4e46-b7a9-0d6a32fcaa0f tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:18 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a 1073741824" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:18 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a Apr 15 00:18:18 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:19 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62cbbb5b-e002-49a3-aaeb-9111aeaf71e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a9c625-9833-4c34-8152-55be993b201a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7604c4b5-1a4c-41f1-9ab1-13c8d6af75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Creating offline snapshot a8b47494-301e-42ba-bfe6-93835820a17b of volume 4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:19 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Volume volume-19a9c625-9833-4c34-8152-55be993b201a (19a9c625-9833-4c34-8152-55be993b201a): created successfully Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7604c4b5-1a4c-41f1-9ab1-13c8d6af75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Flow 'volume_create_manager' (8ac8405c-f8e4-4e2b-b986-6d18d4aa1570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c331951-0f18-4966-85c3-282f10f76d0d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:19 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-cac9f5da-189e-44ec-bf63-410cb4998a59 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created volume successfully. Apr 15 00:18:19 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:19 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:19 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:19 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b 1G Apr 15 00:18:19 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-19a9c625-9833-4c34-8152-55be993b201a-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-19a9c625-9833-4c34-8152-55be993b201a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-19a9c625-9833-4c34-8152-55be993b201a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-19a9c625-9833-4c34-8152-55be993b201a" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[62322b0d-a5de-48d9-8fa2-1ac7504f0540]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:19 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a Apr 15 00:18:19 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:20 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b 1G" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:20 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:20 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:20 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:20 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a Apr 15 00:18:20 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:20 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:20 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b is being set with open permissions: ugo+rw Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:20 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:20 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:20 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-19a9c625-9833-4c34-8152-55be993b201a" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-19a9c625-9833-4c34-8152-55be993b201a" released by "delete_volume" :: held 0.930s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['056ad1d4-c928-406e-aa69-c73771aee277', 'aeecaffe-a9f3-4002-85d6-503a6a33e9db', '6d1ce418-f48b-48f5-841d-8f1eefd35a99', 'e726c1b0-f349-40c6-bba3-10d85f40d687'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:20 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:20 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-59fffd0b-f967-4823-938c-8c4d531f1eec-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-59fffd0b-f967-4823-938c-8c4d531f1eec-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-59fffd0b-f967-4823-938c-8c4d531f1eec" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-59fffd0b-f967-4823-938c-8c4d531f1eec" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500f4f7-aab7-408f-8584-d3013ce49e97]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:21 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec Apr 15 00:18:21 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:21 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:21 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info Apr 15 00:18:21 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:21 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8ed925bd-cc5b-4570-8055-f58053dc2749 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-19a9c625-9833-4c34-8152-55be993b201a-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:21 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec" returned: 0 in 0.492s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:21 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec Apr 15 00:18:21 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:21 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info is being set with open permissions: ugo+rw Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:21 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info Apr 15 00:18:21 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:21 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-59fffd0b-f967-4823-938c-8c4d531f1eec" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-59fffd0b-f967-4823-938c-8c4d531f1eec" released by "delete_volume" :: held 0.930s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['933a183a-d15c-42b9-b795-471a6eedbb87', 'd12b31a7-56d2-415d-9c14-dfa3da21c434', '05984104-ab29-4945-b205-3383e9495366', '48a4678d-2219-4f6a-8768-3e99e1974b1c'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:21 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.info" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.863s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1770541209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:16Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Creating volume 13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:21 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:21 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a 1073741824 Apr 15 00:18:21 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1f2064e4-9c4a-4e4b-9d1a-15fdd385d38a tempest-VolumesSnapshotTestJSON-343923192 None] Create snapshot completed successfully Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:22 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:22 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" acquired by "delete_volume" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2940e0-17c4-488a-935e-b2e98ea2578b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:22 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a Apr 15 00:18:22 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:22 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.451s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c23b0dcb-f540-4ce2-b153-b528a8c5662b tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-59fffd0b-f967-4823-938c-8c4d531f1eec-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:22 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a 1073741824" returned: 0 in 0.586s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:22 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a Apr 15 00:18:22 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (dafa8399-404d-4f00-8931-a73dc395bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a27b3a-27a6-4040-9f81-7c1b3a393942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:22 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a27b3a-27a6-4040-9f81-7c1b3a393942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1946697704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e8b700-bd54-4774-8d65-8591d73c07d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a8b47494-301e-42ba-bfe6-93835820a17b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:23Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a68884-de03-44d7-8716-58c88400955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a68884-de03-44d7-8716-58c88400955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856d4db4-bb31-453b-8047-e810273821f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856d4db4-bb31-453b-8047-e810273821f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a8e8b700-bd54-4774-8d65-8591d73c07d1', 'volume_name': 'volume-a8e8b700-bd54-4774-8d65-8591d73c07d1', 'volume_size': 2, 'snapshot_id': 'a8b47494-301e-42ba-bfe6-93835820a17b'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d79bf06-4dd2-41cb-9e71-ada85c40a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d79bf06-4dd2-41cb-9e71-ada85c40a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6aa585-1a03-4b1e-bfe7-90f1a8e30fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:22 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Volume a8e8b700-bd54-4774-8d65-8591d73c07d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a8e8b700-bd54-4774-8d65-8591d73c07d1', 'volume_size': 2, 'snapshot_id': 'a8b47494-301e-42ba-bfe6-93835820a17b'} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" returned: 0 in 0.609s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:22 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a Apr 15 00:18:22 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:22 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.654s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6add8a3-2366-48a7-ade2-ae93ea0e5334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0963d5b-fe20-422e-80d4-de32f3a09329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Creating offline snapshot 9cb1bbd6-44de-4c27-8420-8c4ddad69598 of volume 9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Volume volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a (13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a): created successfully Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0963d5b-fe20-422e-80d4-de32f3a09329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (990e0f85-7cd5-43dd-8d56-dc3f856990e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fd7bd1-cd87-4d2d-a922-b39000462a9c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:23 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d9e789eb-b362-434f-80b7-58a3e2d3a0de tempest-VolumesTestJSON-1791804397 None] Created volume successfully. Apr 15 00:18:23 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" returned: 0 in 0.454s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a" released by "delete_volume" :: held 1.083s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:23 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a Apr 15 00:18:23 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['8dc6a555-07cb-404d-bbf4-e0a112f685ea', 'dc809af6-b0af-4962-8024-bfb5dca6b58b', '754446e5-b1df-48e1-b016-4f62e92b7751', '0b073881-48fa-475f-9f63-5d7a062bb542'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:23 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:23 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:23 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" returned: 0 in 0.604s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:23 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 1G Apr 15 00:18:23 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (86f6c5f8-fd40-49fc-8bbb-41f931f41355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444d2298-5883-4789-8f39-e023e09eae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444d2298-5883-4789-8f39-e023e09eae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581425382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e02e47-25ba-44bb-921c-ca8f86b47e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:24Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13729a6d-a729-42bf-b49a-ffaa1cffe9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13729a6d-a729-42bf-b49a-ffaa1cffe9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126337d7-56fa-44f5-950d-6ad20ccdd390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126337d7-56fa-44f5-950d-6ad20ccdd390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e02e47-25ba-44bb-921c-ca8f86b47e16', 'volume_name': 'volume-30e02e47-25ba-44bb-921c-ca8f86b47e16', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f3d520-3c44-4449-83c6-5f2638cc1c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f3d520-3c44-4449-83c6-5f2638cc1c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a79253-1a39-4627-b5bb-2a7301288daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Volume 30e02e47-25ba-44bb-921c-ca8f86b47e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e02e47-25ba-44bb-921c-ca8f86b47e16', 'volume_size': 1} Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:23 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-165a0219-4bfe-4b72-af2d-89ad3adf99e1 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-f5dd77d4-f88c-4067-b63d-6ca23b82ea0a-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:24 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 1G" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:24 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 Apr 15 00:18:24 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9317b479-bcd0-4e0c-a70c-4c1fabb82a68]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:24 devstack sudo[87808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e Apr 15 00:18:24 devstack sudo[87808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:24 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598" returned: 0 in 0.456s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:24 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:24 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 Apr 15 00:18:24 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:24 devstack sudo[87808]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:24 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e Apr 15 00:18:24 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:25 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info Apr 15 00:18:25 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e" released by "delete_volume" :: held 0.923s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['fede838d-654a-4ed5-96e6-2269c8651117', 'c48f5b4e-7198-474c-9dbc-e021c3e737f3', '50c9691d-9238-4d23-ba5a-47dbf26f4bcd', '803d7b23-bc79-4148-a6cc-11a461f2de7d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:25 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:25 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-c6a9cccc-3e8d-4225-a77f-91418fce83a7-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-c6a9cccc-3e8d-4225-a77f-91418fce83a7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-c6a9cccc-3e8d-4225-a77f-91418fce83a7" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-c6a9cccc-3e8d-4225-a77f-91418fce83a7" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cfe500-a732-4250-acf5-4aa6d9eab879]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:25 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 Apr 15 00:18:25 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:25 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info Apr 15 00:18:25 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6e6b0587-21be-46e4-ac44-9b01f3da4020 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-b4d6a3ad-ecb4-475c-bb48-38a8ed1cda3e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:25 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7" returned: 0 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:25 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7 Apr 15 00:18:25 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:25 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.info" returned: 0 in 0.456s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.980s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Creating offline snapshot a761ce00-2c10-4fd2-97be-1bbcfdc2eace of volume 22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21feb05-d838-4914-b8d1-82a178f0e8f3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:26 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 Apr 15 00:18:26 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:26 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c6a9cccc-3e8d-4225-a77f-91418fce83a7" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-c6a9cccc-3e8d-4225-a77f-91418fce83a7" released by "delete_volume" :: held 0.926s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['d9c650f0-abd0-42c8-a951-ccbdcb0801a2', '1ec8c200-c5a5-4c4f-96af-18c051352e2e', 'ec495a62-21d1-47db-8682-3bbb47b53354', 'fa003c8e-77a8-44ac-82c4-fe43241d0525'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:26 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:26 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-b21334a2-bfa9-4f5a-9f6c-acf0104abae2-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:26 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0" returned: 0 in 0.485s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-b21334a2-bfa9-4f5a-9f6c-acf0104abae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-b21334a2-bfa9-4f5a-9f6c-acf0104abae2" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:26 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace 1G Apr 15 00:18:26 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-b21334a2-bfa9-4f5a-9f6c-acf0104abae2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleting offline snapshot b21334a2-bfa9-4f5a-9f6c-acf0104abae2 of volume de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] snapshot_file for this snap is: volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[69993b31-8dff-4b77-9b26-c6107cb4d04a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:26 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 Apr 15 00:18:26 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:26 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-534eda37-46fd-4027-a51c-2ab0f5d4f768 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-c6a9cccc-3e8d-4225-a77f-91418fce83a7-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:26 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace 1G" returned: 0 in 0.505s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:27 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace Apr 15 00:18:27 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:27 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2" returned: 0 in 0.516s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de47d024-4a82-4c6a-b31c-eb58d6b74565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ae19ee-5de9-41b4-9bd9-69b82687987f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:27 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 Apr 15 00:18:27 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:27 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:27 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:27 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace Apr 15 00:18:27 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:27 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565" returned: 0 in 0.501s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:27 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 Apr 15 00:18:27 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:27 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:27 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info Apr 15 00:18:27 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:28 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:28 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2 Apr 15 00:18:28 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:28 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:28 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:28 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info Apr 15 00:18:28 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:28 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565.b21334a2-bfa9-4f5a-9f6c-acf0104abae2" returned: 0 in 0.422s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-b21334a2-bfa9-4f5a-9f6c-acf0104abae2" released by "_delete_snapshot" :: held 1.965s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" released by "delete_snapshot" :: held 1.976s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['9d411725-1c29-4373-8ba3-7c891f3f98bf', '9aa072be-42bb-4d8d-87d2-c70bd5fa9bfa', '836894bc-da76-4525-9d40-eecb599a4549', 'c8570d8d-878d-47f8-a291-1b9cd4345793'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Delete snapshot completed successfully. Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cce1f4ce-633c-45f9-8871-89899d3f321e tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-b21334a2-bfa9-4f5a-9f6c-acf0104abae2-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-de47d024-4a82-4c6a-b31c-eb58d6b74565-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-de47d024-4a82-4c6a-b31c-eb58d6b74565-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d64a1-4935-4f0b-a53b-4732d6f60f45]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:28 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 Apr 15 00:18:28 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:28 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.info" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-581425382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e02e47-25ba-44bb-921c-ca8f86b47e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='11a67db403114ae3978730bc62fe366b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:24Z,use_quota=True,user_id='110607f2cb5342b9bc30e475561cd781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Creating volume 30e02e47-25ba-44bb-921c-ca8f86b47e16 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:28 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:28 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 1073741824 Apr 15 00:18:28 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-52180d41-471b-48cb-b0d6-a71a0e8e9d40 tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: created successfully Apr 15 00:18:29 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:29 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565 Apr 15 00:18:29 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:29 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 1073741824" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:29 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 Apr 15 00:18:29 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:29 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-de47d024-4a82-4c6a-b31c-eb58d6b74565" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-quobyte-de47d024-4a82-4c6a-b31c-eb58d6b74565" released by "delete_volume" :: held 0.948s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Created reservations ['ec39889d-88ea-4661-879a-cdd6d0b931e2', 'cc67cd0f-aa0f-4f90-a9ee-3a563d25f80f', '37fac5e4-4701-469f-ad26-2dd1ef1084da', '65b36f5a-2c81-4b03-a725-8dd443354e3f'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:29 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:29 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:29 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b-a8e8b700-bd54-4774-8d65-8591d73c07d1" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a79253-1a39-4627-b5bb-2a7301288daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e02e47-25ba-44bb-921c-ca8f86b47e16', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae165d39-7538-4b0f-bdc5-9c18ba4a94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b-a8e8b700-bd54-4774-8d65-8591d73c07d1" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Creating volume a8e8b700-bd54-4774-8d65-8591d73c07d1 from snapshot a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Volume volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 (30e02e47-25ba-44bb-921c-ca8f86b47e16): created successfully Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae165d39-7538-4b0f-bdc5-9c18ba4a94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Flow 'volume_create_manager' (86f6c5f8-fd40-49fc-8bbb-41f931f41355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: deleting Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] snapshot: a8b47494-301e-42ba-bfe6-93835820a17b, volume: a8e8b700-bd54-4774-8d65-8591d73c07d1, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:18:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9e43a367-f2cf-41cf-b626-e9010f4d01db tempest-VolumesTestJSON-1791804397 None] Created volume successfully. Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: deleting {{(pid=83219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[48775023-a753-45f6-a6f8-7365f6017d5f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-9cb1bbd6-44de-4c27-8420-8c4ddad69598" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9cb1bbd6-44de-4c27-8420-8c4ddad69598" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Deleting offline snapshot 9cb1bbd6-44de-4c27-8420-8c4ddad69598 of volume 9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] snapshot_file for this snap is: volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007fe5a-7a9f-4f33-90ca-138d4b2a822d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:30 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 Apr 15 00:18:30 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:30 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:30 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:30 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:30 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Deleted volume successfully. Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-36baeacc-b172-4e16-b52b-7a4d9e443b19 tempest-CreateVolumesFromSnapshotTest-892128842 None] Lock "cinder-de47d024-4a82-4c6a-b31c-eb58d6b74565-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:30 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598" returned: 0 in 0.667s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c318f-5807-48d3-8579-bab7df2374d5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:30 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.844s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b3173-6eee-471d-bfea-bd0965bef547]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:30 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a Apr 15 00:18:30 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:30 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:30 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-30e02e47-25ba-44bb-921c-ca8f86b47e16-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-30e02e47-25ba-44bb-921c-ca8f86b47e16-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-quobyte-30e02e47-25ba-44bb-921c-ca8f86b47e16" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-30e02e47-25ba-44bb-921c-ca8f86b47e16" acquired by "delete_volume" :: waited 0.025s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e035c904-d69b-436f-88c4-ff76bd510a35]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:31 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 Apr 15 00:18:31 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:31 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" returned: 0 in 0.648s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:31 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 Apr 15 00:18:31 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:31 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.619s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:31 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 Apr 15 00:18:31 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:31 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16" returned: 0 in 0.579s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:31 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16 Apr 15 00:18:31 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:31 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=181,cinder:INSERT=42,cinder:DELETE=16,cinder:SELECT=165 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598" returned: 0 in 0.739s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:32 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598 Apr 15 00:18:32 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (1be17a1f-8c3e-4a55-892a-46d14e0b92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea063567-8d8f-46ec-9532-61066a8d3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea063567-8d8f-46ec-9532-61066a8d3a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474248074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a47253-22d7-4e67-852e-89209f1101a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:32Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de437d-55b6-41e4-af08-8b8436ae064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1de437d-55b6-41e4-af08-8b8436ae064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10861846-091c-4be8-b2f6-fbfc61ef716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10861846-091c-4be8-b2f6-fbfc61ef716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a47253-22d7-4e67-852e-89209f1101a9', 'volume_name': 'volume-32a47253-22d7-4e67-852e-89209f1101a9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c678f616-4008-4aa0-97ca-9634aa6ac74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c678f616-4008-4aa0-97ca-9634aa6ac74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41694a1c-f412-4a51-ac0d-39a0baebbbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:32 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume 32a47253-22d7-4e67-852e-89209f1101a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a47253-22d7-4e67-852e-89209f1101a9', 'volume_size': 1} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:32 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-30e02e47-25ba-44bb-921c-ca8f86b47e16" returned: 0 in 1.125s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-30e02e47-25ba-44bb-921c-ca8f86b47e16" released by "delete_volume" :: held 1.737s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Created reservations ['15173e0b-d001-4abd-9e52-3ef7e8f484da', 'feae3b66-086b-48f2-b399-621412edcbb9', '46743487-f7cc-4554-ac62-1526a0efae4e', '2abd7556-9a26-4861-9f44-804935db1d41'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:33 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:33 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:33 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a.9cb1bbd6-44de-4c27-8420-8c4ddad69598" returned: 0 in 1.130s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9cb1bbd6-44de-4c27-8420-8c4ddad69598" released by "_delete_snapshot" :: held 3.264s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" released by "delete_snapshot" :: held 3.283s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-a761ce00-2c10-4fd2-97be-1bbcfdc2eace" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-a761ce00-2c10-4fd2-97be-1bbcfdc2eace" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Deleting offline snapshot a761ce00-2c10-4fd2-97be-1bbcfdc2eace of volume 22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] snapshot_file for this snap is: volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb041e92-f336-490c-8381-2acb4769e95c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-quobyte-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" acquired by "delete_volume" :: waited 0.032s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeee3ab6-07ff-4293-9264-7f3e372e8167]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:33 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace Apr 15 00:18:33 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:33 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a Apr 15 00:18:33 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:33 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1" returned: 0 in 2.400s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea7d50e-3623-4244-8ebc-8934c507e0e5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:33 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:33 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:33 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.897s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:33 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Deleted volume successfully. Apr 15 00:18:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fee3c915-b44b-472e-8a7e-36b4040b4082 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-30e02e47-25ba-44bb-921c-ca8f86b47e16-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:34 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace" returned: 0 in 0.688s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b80866-92cd-47c9-94d4-9b91fd62dea0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:34 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" returned: 0 in 0.501s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2027454-372c-4cc5-a424-313b0b0cc0b2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a Apr 15 00:18:34 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 Apr 15 00:18:34 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.670s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:18:34 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Converted 1024.00 MB image at 426.51 MB/s Apr 15 00:18:34 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 is being set with open permissions: ugo+rw Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 Apr 15 00:18:34 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a" released by "delete_volume" :: held 0.972s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Created reservations ['f67ec934-aafd-42c6-9442-c060dbc1a5af', '52d1933e-572b-49d0-82f8-11145eb006d9', '40720c90-34ad-499f-946a-a96ea017fc71', 'ea2baae9-f677-4ddd-a5ff-f194d9b629ae'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:34 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace Apr 15 00:18:34 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-96ca37d6-3164-4f75-a152-6403d8c86a2f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-96ca37d6-3164-4f75-a152-6403d8c86a2f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:34 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:34 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "cinder-quobyte-96ca37d6-3164-4f75-a152-6403d8c86a2f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-96ca37d6-3164-4f75-a152-6403d8c86a2f" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f8df23-3fe9-46ad-836b-7cf1d14c8490]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f Apr 15 00:18:34 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" released by "_copy_volume_from_snapshot" :: held 5.086s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b-a8e8b700-bd54-4774-8d65-8591d73c07d1" released by "_create_volume_from_snapshot" :: held 5.139s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.166s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-474248074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a47253-22d7-4e67-852e-89209f1101a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:32Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume 32a47253-22d7-4e67-852e-89209f1101a9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:34 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:34 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 1073741824 Apr 15 00:18:34 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6aa585-1a03-4b1e-bfe7-90f1a8e30fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e8b700-bd54-4774-8d65-8591d73c07d1', 'volume_size': 2, 'snapshot_id': 'a8b47494-301e-42ba-bfe6-93835820a17b'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38b0387-3d72-46d8-aae2-6beee5d26748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:34 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Volume volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 (a8e8b700-bd54-4774-8d65-8591d73c07d1): created successfully Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38b0387-3d72-46d8-aae2-6beee5d26748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (dafa8399-404d-4f00-8931-a73dc395bb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a2e78dac-b02f-4d92-926c-028cc1ebc3e0 tempest-VolumesSnapshotTestJSON-343923192 None] Created volume successfully. Apr 15 00:18:35 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Deleted volume successfully. Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f899c035-84ca-4a9d-8c64-0012131a20d4 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-13e315ce-3ccb-4b1f-9cc6-d2a81bbfec0a-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:35 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace" returned: 0 in 0.564s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:35 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace Apr 15 00:18:35 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:35 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f" returned: 0 in 0.577s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:35 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f Apr 15 00:18:35 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:35 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 1073741824" returned: 0 in 0.585s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:35 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 Apr 15 00:18:35 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-a8e8b700-bd54-4774-8d65-8591d73c07d1-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a8e8b700-bd54-4774-8d65-8591d73c07d1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:35 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0.a761ce00-2c10-4fd2-97be-1bbcfdc2eace" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69ec29-e93f-4d3f-b041-d50f718969a6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-a761ce00-2c10-4fd2-97be-1bbcfdc2eace" released by "_delete_snapshot" :: held 2.340s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" released by "delete_snapshot" :: held 2.378s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:35 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1421568492 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1421568492, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:35 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1421568492 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1421568492, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['211eb2b2-fba0-4f9b-87fa-b5960aefdb56', 'e8af7f37-915e-4b4f-bff4-e8d895fc72f8', '64ec42a8-5871-44fb-9bc8-64ca8b6a89c3', '4a727e62-04d4-4c29-a54a-6516eaa5564b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:35 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 Apr 15 00:18:35 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['af3cd244-0fba-4ade-911a-fef6f0485b82', '35e0b68d-0995-45ae-a398-5fdeb08191a8', 'b9b14c93-3a86-4fae-9cb0-9d26310e2f20', '1b8a0bae-186d-4865-842c-50495ca376ac'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:35 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-96ca37d6-3164-4f75-a152-6403d8c86a2f" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-quobyte-96ca37d6-3164-4f75-a152-6403d8c86a2f" released by "delete_volume" :: held 1.120s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b78a9d44-79a1-448b-87a6-d979ceb3a477 tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 4ebf6858-f69b-468c-b6ba-a5c28ff2673f: deleted successfully Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Created reservations ['31bcdd00-032c-4468-95a4-df3ca8b50dc1', 'ac3bb345-d2e6-436f-b629-f5dbe395e4eb', '7a759475-63ad-4fd1-b2b2-578e8efabeb9', '5e11d171-7a44-4e4c-981d-b378b35a68f2'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:35 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:35 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:36 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41694a1c-f412-4a51-ac0d-39a0baebbbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a47253-22d7-4e67-852e-89209f1101a9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2919d7d-03f8-40fd-85b1-4fcd1c1494e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-32a47253-22d7-4e67-852e-89209f1101a9 (32a47253-22d7-4e67-852e-89209f1101a9): created successfully Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2919d7d-03f8-40fd-85b1-4fcd1c1494e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (1be17a1f-8c3e-4a55-892a-46d14e0b92f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d22c359c-de9c-4ad1-94b8-693f46e466db tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:36 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:36 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1 Apr 15 00:18:36 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:36 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.429s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Deleted volume successfully. Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-110d2c74-525d-4f35-b446-d23a1f2e71c8 tempest-VolumesTestJSON-1791804397 None] Lock "cinder-96ca37d6-3164-4f75-a152-6403d8c86a2f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c807e0-87a5-47c8-a077-bd03a7269d9d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:36 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a8e8b700-bd54-4774-8d65-8591d73c07d1" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8e8b700-bd54-4774-8d65-8591d73c07d1" released by "delete_volume" :: held 1.017s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:36 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 Apr 15 00:18:36 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (44beb5a4-b4af-4d4a-8569-8e3ead2f285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e46f72-f3ff-4590-9570-f94be8be0123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e46f72-f3ff-4590-9570-f94be8be0123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167717049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9b1dc1-6e28-43f8-b954-e2093ce3e40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2177b1fb-e0f3-472c-81e7-a74d5627569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2177b1fb-e0f3-472c-81e7-a74d5627569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b05d9-8ab3-40a8-be37-3da9099c0f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33b05d9-8ab3-40a8-be37-3da9099c0f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9b1dc1-6e28-43f8-b954-e2093ce3e40f', 'volume_name': 'volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebea138-3afa-4383-9774-e22ed270c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebea138-3afa-4383-9774-e22ed270c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c9aca0-ab6c-447b-8481-a88f692eea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:36 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume 9f9b1dc1-6e28-43f8-b954-e2093ce3e40f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f', 'volume_size': 1} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-167717049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9b1dc1-6e28-43f8-b954-e2093ce3e40f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume 9f9b1dc1-6e28-43f8-b954-e2093ce3e40f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:36 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['e0395561-e158-415f-9ec6-7d908749219a', '5a45e23b-d0e0-457b-8191-856f2bc7cd3a', 'be4e7eaf-ed37-4836-822b-89e681682db3', 'c04a40e4-6336-46cb-9f61-bfcfa5f350a7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:36 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f 1073741824 Apr 15 00:18:36 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:36 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:36 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:36 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (d7c31377-0c50-4d9a-895b-0461a82ef0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23166189-818a-468a-b28a-e622fc2799e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23166189-818a-468a-b28a-e622fc2799e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628041597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc91dac-2030-40b4-8207-9665f81abf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540c44c-66c7-414d-8f72-ebe4c348c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540c44c-66c7-414d-8f72-ebe4c348c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c46baff-58ba-4afc-bb16-f03a23d0d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c46baff-58ba-4afc-bb16-f03a23d0d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abc91dac-2030-40b4-8207-9665f81abf71', 'volume_name': 'volume-abc91dac-2030-40b4-8207-9665f81abf71', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22238b-4163-47e5-a156-2aa6c11ef013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d22238b-4163-47e5-a156-2aa6c11ef013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8db1d37-0eb7-42a2-8409-e1ae75308e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume abc91dac-2030-40b4-8207-9665f81abf71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abc91dac-2030-40b4-8207-9665f81abf71', 'volume_size': 1} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (f96a5327-ce03-4d1f-a7db-067ff9fc8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6471cb05-5e29-4799-85ef-711b216ec287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6471cb05-5e29-4799-85ef-711b216ec287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178656287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919dd384-e183-40f6-b2ea-20c8fe9fe867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b1a04-ae5c-407b-8251-60396d6bdc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0b1a04-ae5c-407b-8251-60396d6bdc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602d7597-b555-4ad8-b7a4-fcaba508cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602d7597-b555-4ad8-b7a4-fcaba508cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919dd384-e183-40f6-b2ea-20c8fe9fe867', 'volume_name': 'volume-919dd384-e183-40f6-b2ea-20c8fe9fe867', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfff0efd-98ff-41e0-891c-94e5b7cb6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfff0efd-98ff-41e0-891c-94e5b7cb6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec8072e-56ba-4dc1-a165-06c12312d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume 919dd384-e183-40f6-b2ea-20c8fe9fe867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919dd384-e183-40f6-b2ea-20c8fe9fe867', 'volume_size': 1} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:37 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (16a72166-f118-4e54-bd0d-96adcf9b42d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c49348-921c-4243-8567-ba8e988d83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f 1073741824" returned: 0 in 0.713s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:37 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c49348-921c-4243-8567-ba8e988d83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-637905135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f1866b-9967-47a0-9710-6e23b3111d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccc97bc-652c-4f14-b90d-17d954f2ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccc97bc-652c-4f14-b90d-17d954f2ca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8484f0d7-116f-489f-a890-55651cf9f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8484f0d7-116f-489f-a890-55651cf9f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f1866b-9967-47a0-9710-6e23b3111d1b', 'volume_name': 'volume-d3f1866b-9967-47a0-9710-6e23b3111d1b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aa2bd3-70b6-4b11-89e5-748b7d3cfc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2aa2bd3-70b6-4b11-89e5-748b7d3cfc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3ef5b7-c19c-4d4a-bdea-e33ddaed9c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume d3f1866b-9967-47a0-9710-6e23b3111d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f1866b-9967-47a0-9710-6e23b3111d1b', 'volume_size': 1} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0" returned: 0 in 0.946s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:37 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0 Apr 15 00:18:37 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:37 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f Apr 15 00:18:37 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (33554437-8d43-4031-ba00-4881e01ba0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a69094-eb12-4ee2-9313-c64dc9ddb8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a69094-eb12-4ee2-9313-c64dc9ddb8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701212972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e894a-822d-4fa2-9861-cc71085d9510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:38Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2fcca7-2195-4cf5-b14e-12dbf94fae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2fcca7-2195-4cf5-b14e-12dbf94fae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f02f717-2f61-4791-9063-07f09f2a7c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f02f717-2f61-4791-9063-07f09f2a7c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064e894a-822d-4fa2-9861-cc71085d9510', 'volume_name': 'volume-064e894a-822d-4fa2-9861-cc71085d9510', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62302820-59b0-4612-960e-82cb85d8b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62302820-59b0-4612-960e-82cb85d8b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0850ff5a-14f0-4593-9c0c-cc1873be70ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume 064e894a-822d-4fa2-9861-cc71085d9510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064e894a-822d-4fa2-9861-cc71085d9510', 'volume_size': 1} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.899s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Deleted volume successfully. Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6a26cca1-82c4-4d2a-b4f6-7cdac3351ade tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a8e8b700-bd54-4774-8d65-8591d73c07d1-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-a8b47494-301e-42ba-bfe6-93835820a17b-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a8b47494-301e-42ba-bfe6-93835820a17b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Deleting offline snapshot a8b47494-301e-42ba-bfe6-93835820a17b of volume 4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] snapshot_file for this snap is: volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4138bc71-33e6-4031-a848-4691d635a9a5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:38 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:38 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" returned: 0 in 0.644s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-628041597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc91dac-2030-40b4-8207-9665f81abf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume abc91dac-2030-40b4-8207-9665f81abf71 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:38 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-22b80866-92cd-47c9-94d4-9b91fd62dea0" returned: 0 in 0.684s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3c9aca0-ab6c-447b-8481-a88f692eea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ee05df-500c-4226-a11d-6fec59fc86bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:38 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 1073741824 Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-22b80866-92cd-47c9-94d4-9b91fd62dea0" released by "delete_volume" :: held 1.693s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:38 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f (9f9b1dc1-6e28-43f8-b954-e2093ce3e40f): created successfully Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ee05df-500c-4226-a11d-6fec59fc86bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (44beb5a4-b4af-4d4a-8569-8e3ead2f285f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-86265c08-5589-404f-8f38-20aac823dbd9 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ab5f4e-a2a4-4e87-8122-0ded569dd6c7]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a Apr 15 00:18:38 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:38 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.608s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011e279-db61-451a-bb6f-ca7498f62c0e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:38 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:38 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 1073741824" returned: 0 in 0.652s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 Apr 15 00:18:38 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:38 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" returned: 0 in 0.655s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:38 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a Apr 15 00:18:38 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:39 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.562s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:39 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:39 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:39 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.089s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178656287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919dd384-e183-40f6-b2ea-20c8fe9fe867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume 919dd384-e183-40f6-b2ea-20c8fe9fe867 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:39 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8db1d37-0eb7-42a2-8409-e1ae75308e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc91dac-2030-40b4-8207-9665f81abf71', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d68f8e-c717-4c26-8890-55a21b7200e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:39 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:39 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 1073741824 Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:39 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-9b2d1793-34a2-4d46-bc6f-f6e2a046f77a" released by "delete_volume" :: held 1.172s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:39 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-abc91dac-2030-40b4-8207-9665f81abf71 (abc91dac-2030-40b4-8207-9665f81abf71): created successfully Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d68f8e-c717-4c26-8890-55a21b7200e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (d7c31377-0c50-4d9a-895b-0461a82ef0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:39 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-77a1a282-d1dd-48a0-b19f-a9f8daadc8e1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['be56fa98-f63c-4afe-bbd7-5b977a1e52b8'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:39 devstack cinder-volume[83219]: WARNING cinder.quota [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1421568492 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1421568492, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['0ce9af05-b5ea-492c-8158-1e0b08341d36', '144598c5-00ec-44eb-8285-ace1659b2ef5', '361e5583-d523-4fa8-84e0-54c832e6f79f', '1b3e92f4-6ae0-443a-b473-b9e005d45382'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:39 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:39 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b Apr 15 00:18:39 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['16faba89-cbee-4784-bd1f-e5eb75d156db', 'c1c45db6-8901-4fa2-9164-8dfcbfb96b1f', '33765e44-36ba-47e3-921a-cd1d066b579c', '1ef5a615-6639-41a6-b66f-972060ad7118'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:39 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:39 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:40 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 1073741824" returned: 0 in 0.675s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:40 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 Apr 15 00:18:40 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:40 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194.a8b47494-301e-42ba-bfe6-93835820a17b" returned: 0 in 0.662s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7f24730d-d06e-4d2c-bf92-3d13d342d2f9 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1503122802: creating Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a8b47494-301e-42ba-bfe6-93835820a17b" released by "_delete_snapshot" :: held 2.434s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" released by "delete_snapshot" :: held 2.449s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7f24730d-d06e-4d2c-bf92-3d13d342d2f9 tempest-GroupSnapshotsTest-1038558844 None] Group tempest-GroupSnapshotsTest-Group-1503122802: created successfully Apr 15 00:18:40 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7f24730d-d06e-4d2c-bf92-3d13d342d2f9 tempest-GroupSnapshotsTest-1038558844 None] Create group completed successfully. Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.615s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8babd1ae-733e-469e-9165-1f14dededdb0 tempest-GroupSnapshotsTest-1038558844 None] Delete group completed successfully. Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['41c4d713-bb4f-4417-a77a-07eddbaa5b58', '2ec69a74-d672-4574-944f-9dad15495489', 'c752ec48-a8a4-4dca-8708-f1c3a653f013', '1c54a27c-7eec-4249-8cc3-f0e234f2a57a'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Delete snapshot completed successfully. Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-183b7629-8fb0-49c7-9f4e-6a0b11d2615c tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a8b47494-301e-42ba-bfe6-93835820a17b-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:40 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867" returned: 0 in 0.536s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.093s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-637905135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f1866b-9967-47a0-9710-6e23b3111d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:37Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume d3f1866b-9967-47a0-9710-6e23b3111d1b {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec8072e-56ba-4dc1-a165-06c12312d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919dd384-e183-40f6-b2ea-20c8fe9fe867', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447dd7eb-3a39-4730-b2e8-8dc7c25b261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:40 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b 1073741824 Apr 15 00:18:40 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 (919dd384-e183-40f6-b2ea-20c8fe9fe867): created successfully Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (447dd7eb-3a39-4730-b2e8-8dc7c25b261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:40 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (f96a5327-ce03-4d1f-a7db-067ff9fc8453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e47628d3-d9fb-459b-a0ea-81975ade0206 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-4b6c3221-6ebd-4c5c-b68a-3b406851d194-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-4b6c3221-6ebd-4c5c-b68a-3b406851d194-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d3a6c-4394-49c3-b485-ba3c68db1813]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:41 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:41 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:41 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b 1073741824" returned: 0 in 0.690s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:41 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b Apr 15 00:18:41 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (acb7bb25-a165-4ede-a93d-9ee99fbd9c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dd96d0-3abb-45e6-9a07-8b02c3e8b209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dd96d0-3abb-45e6-9a07-8b02c3e8b209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153560642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f5ae3d2-6e27-4415-93d9-f711e6402ddd,host='devstack@QuobyteHD#QuobyteHD',id=0087aa36-0453-4512-aebe-0429aac7033f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:42Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4ce0ca5-8381-4c32-bfae-1e2d2fc7fc8c),volume_type_id=c4ce0ca5-8381-4c32-bfae-1e2d2fc7fc8c)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811b8d3-9fe1-461c-90c6-248baca0f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811b8d3-9fe1-461c-90c6-248baca0f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5450457-5bca-4981-a3a5-475b06498dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5450457-5bca-4981-a3a5-475b06498dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0087aa36-0453-4512-aebe-0429aac7033f', 'volume_name': 'volume-0087aa36-0453-4512-aebe-0429aac7033f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2a3d9-b3e2-4b84-99f2-b57d84ce8c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2a3d9-b3e2-4b84-99f2-b57d84ce8c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c59cca0-3748-4d0b-87ad-57be1029382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Volume 0087aa36-0453-4512-aebe-0429aac7033f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0087aa36-0453-4512-aebe-0429aac7033f', 'volume_size': 1} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:41 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.587s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:41 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194 Apr 15 00:18:41 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:41 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b" returned: 0 in 0.566s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701212972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e894a-822d-4fa2-9861-cc71085d9510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88428055985e4afeb4bf2bb17b07fab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:38Z,use_quota=True,user_id='51e1e585989f471b882564fd91b87dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Creating volume 064e894a-822d-4fa2-9861-cc71085d9510 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:41 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3ef5b7-c19c-4d4a-bdea-e33ddaed9c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f1866b-9967-47a0-9710-6e23b3111d1b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 1073741824 Apr 15 00:18:41 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7b1c59-3b17-4660-a169-6d43281320b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-d3f1866b-9967-47a0-9710-6e23b3111d1b (d3f1866b-9967-47a0-9710-6e23b3111d1b): created successfully Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7b1c59-3b17-4660-a169-6d43281320b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (16a72166-f118-4e54-bd0d-96adcf9b42d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-075bf4c3-862f-4740-933d-a27d974decf0 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:42 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:42 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:42 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b6c3221-6ebd-4c5c-b68a-3b406851d194" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-4b6c3221-6ebd-4c5c-b68a-3b406851d194" released by "delete_volume" :: held 1.133s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['628daf04-b189-45dc-ad09-706651dc5e2d', '61de7d06-cd82-4274-b9ac-2909abc3f916', '13778671-33b4-42ac-a93a-3f2cdf08be2f', '1556db36-9a1c-4e2c-bc40-dd6fb0e55bc4'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:42 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:42 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:42 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 1073741824" returned: 0 in 0.613s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:42 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 Apr 15 00:18:42 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:42 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.499s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:42 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Deleted volume successfully. Apr 15 00:18:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6f83536f-54be-4f6c-a755-fc3133862812 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-4b6c3221-6ebd-4c5c-b68a-3b406851d194-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:43 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2f5ae3d2-6e27-4415-93d9-f711e6402ddd,created_at=2026-04-14T22:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1153560642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2f5ae3d2-6e27-4415-93d9-f711e6402ddd,host='devstack@QuobyteHD#QuobyteHD',id=0087aa36-0453-4512-aebe-0429aac7033f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4d21ca5f4fc4c97a16017bc4980fa50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:42Z,use_quota=True,user_id='a657042c4654476baba720b3f458f5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4ce0ca5-8381-4c32-bfae-1e2d2fc7fc8c),volume_type_id=c4ce0ca5-8381-4c32-bfae-1e2d2fc7fc8c)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Creating volume 0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:43 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0850ff5a-14f0-4593-9c0c-cc1873be70ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064e894a-822d-4fa2-9861-cc71085d9510', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f 1073741824 Apr 15 00:18:43 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0d1a7c-389b-486d-b05a-cbba0e86752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Volume volume-064e894a-822d-4fa2-9861-cc71085d9510 (064e894a-822d-4fa2-9861-cc71085d9510): created successfully Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0d1a7c-389b-486d-b05a-cbba0e86752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Flow 'volume_create_manager' (33554437-8d43-4031-ba00-4881e01ba0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:43 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-df38affa-3322-4543-a48d-bee1c2aea670 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created volume successfully. Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-064e894a-822d-4fa2-9861-cc71085d9510-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-064e894a-822d-4fa2-9861-cc71085d9510-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-064e894a-822d-4fa2-9861-cc71085d9510" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-064e894a-822d-4fa2-9861-cc71085d9510" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861de44-8a53-4e34-b1b7-baabbf4a9826]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:43 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 Apr 15 00:18:43 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:43 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f 1073741824" returned: 0 in 0.568s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:43 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f Apr 15 00:18:43 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (327ab50a-6603-4889-af15-503054a4cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93e29e6-a4c0-429e-a458-cec5b8d6302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d93e29e6-a4c0-429e-a458-cec5b8d6302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66474582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527679a-7f45-45d8-9094-312e115d2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:44Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487e3bf4-c579-4868-8cfe-e743379f2abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487e3bf4-c579-4868-8cfe-e743379f2abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab738949-80aa-494e-9592-864d2a975871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab738949-80aa-494e-9592-864d2a975871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6527679a-7f45-45d8-9094-312e115d2bc1', 'volume_name': 'volume-6527679a-7f45-45d8-9094-312e115d2bc1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8249a6-c0bb-40e5-a6ac-de8d6eb14bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8249a6-c0bb-40e5-a6ac-de8d6eb14bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f9b7d-d477-4363-a7bb-c180ff256b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:43 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Volume 6527679a-7f45-45d8-9094-312e115d2bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6527679a-7f45-45d8-9094-312e115d2bc1', 'volume_size': 1} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:43 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510" returned: 0 in 0.528s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:43 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510 Apr 15 00:18:43 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:44 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f" returned: 0 in 0.421s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66474582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6527679a-7f45-45d8-9094-312e115d2bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:44Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Creating volume 6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:44 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c59cca0-3748-4d0b-87ad-57be1029382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0087aa36-0453-4512-aebe-0429aac7033f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:44 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 1073741824 Apr 15 00:18:44 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48558348-6d1e-4f4e-8029-4ee6930f701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:44 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Volume volume-0087aa36-0453-4512-aebe-0429aac7033f (0087aa36-0453-4512-aebe-0429aac7033f): created successfully Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48558348-6d1e-4f4e-8029-4ee6930f701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Flow 'volume_create_manager' (acb7bb25-a165-4ede-a93d-9ee99fbd9c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:44 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-040849ba-3887-46de-8785-7db2409a21c2 tempest-GroupSnapshotsTest-1038558844 None] Created volume successfully. Apr 15 00:18:44 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-064e894a-822d-4fa2-9861-cc71085d9510" returned: 0 in 0.445s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-064e894a-822d-4fa2-9861-cc71085d9510" released by "delete_volume" :: held 1.007s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['65c5ab9f-b217-44aa-825c-4ea404abb171', '135bc300-8f7a-4c2c-a90a-a272f4b1cd66', 'c3a87a9e-f4cc-49b2-a0fe-722a668aacab', '90c19977-8297-442d-9439-d3a48e6129a2'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:44 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:44 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:44 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 1073741824" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:44 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:18:44 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:44 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:44 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-27554c87-43d2-438b-85a9-005d4e0e88fc tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-064e894a-822d-4fa2-9861-cc71085d9510-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:45 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] GroupSnapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: creating. Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Group snapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: creating. {{(pid=83219) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:45 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.040s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389f9b7d-d477-4363-a7bb-c180ff256b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6527679a-7f45-45d8-9094-312e115d2bc1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27cf578-13d4-4ff2-9cea-59e12b98abf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Creating offline snapshot baeca567-462d-4e7d-80ce-f317e1db3c50 of volume 0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:45 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Volume volume-6527679a-7f45-45d8-9094-312e115d2bc1 (6527679a-7f45-45d8-9094-312e115d2bc1): created successfully Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27cf578-13d4-4ff2-9cea-59e12b98abf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (327ab50a-6603-4889-af15-503054a4cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa39c3-cce3-491b-a093-5eac95d5ac91]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:45 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c17e8fe2-8868-41f3-af41-a66412d61ee5 tempest-VolumesSnapshotTestJSON-343923192 None] Created volume successfully. Apr 15 00:18:45 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f Apr 15 00:18:45 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-d3f1866b-9967-47a0-9710-6e23b3111d1b-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-d3f1866b-9967-47a0-9710-6e23b3111d1b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-d3f1866b-9967-47a0-9710-6e23b3111d1b" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-d3f1866b-9967-47a0-9710-6e23b3111d1b" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df07929-f257-40e8-91c7-f095009fb52c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:45 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:45 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b Apr 15 00:18:45 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:45 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 1G Apr 15 00:18:45 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:46 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b" returned: 0 in 0.564s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:46 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 1G" returned: 0 in 0.524s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0087aa36-0453-4512-aebe-0429aac7033f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:46 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b Apr 15 00:18:46 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:46 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0087aa36-0453-4512-aebe-0429aac7033f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 Apr 15 00:18:46 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:46 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d3f1866b-9967-47a0-9710-6e23b3111d1b" returned: 0 in 0.448s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-d3f1866b-9967-47a0-9710-6e23b3111d1b" released by "delete_volume" :: held 1.035s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['944d79be-5491-48c9-ba28-ad25e2eaa15f', 'd19323f3-5ac0-4761-8784-4862b99fc008', 'd35839e1-2c1e-4a91-9615-c9dbb06ff150', 'b800aa00-f102-453a-be23-ed2855f042de'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:46 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0087aa36-0453-4512-aebe-0429aac7033f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:46 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:46 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 Apr 15 00:18:46 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:46 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:46 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:47 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50" returned: 0 in 0.451s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:47 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info Apr 15 00:18:47 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:47 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.502s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-725da2e7-1be4-4491-a491-efad20548d74 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-d3f1866b-9967-47a0-9710-6e23b3111d1b-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:47 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:47 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:47 devstack sudo[88218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info Apr 15 00:18:47 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-919dd384-e183-40f6-b2ea-20c8fe9fe867-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-919dd384-e183-40f6-b2ea-20c8fe9fe867-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-919dd384-e183-40f6-b2ea-20c8fe9fe867" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-919dd384-e183-40f6-b2ea-20c8fe9fe867" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da1b3a1-bd06-4974-bfa9-64d99779f451]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:47 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 Apr 15 00:18:47 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:48 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.info" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.020s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.240s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Creating offline snapshot a9724b7c-b394-4af3-92b6-1ca3b80cd573 of volume 6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a48ca8-b2e8-4f22-a68c-22844d186e08]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-81534bef-abe5-4c75-98fc-7ab9e37ae80f tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: created successfully Apr 15 00:18:48 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:18:48 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:48 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867" returned: 0 in 0.572s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:48 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867 Apr 15 00:18:48 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:48 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:48 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 1G Apr 15 00:18:48 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:48 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-919dd384-e183-40f6-b2ea-20c8fe9fe867" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-919dd384-e183-40f6-b2ea-20c8fe9fe867" released by "delete_volume" :: held 1.082s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['bbfa533e-8622-46ea-a389-38e603b44548', 'd4fc07b8-09db-4a35-8539-80099b916c26', '5d1510b0-4d54-48b9-a852-9833e88e26e3', 'c4f482ae-6265-489b-8943-73f036a8c7f8'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:48 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:48 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:49 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 1G" returned: 0 in 0.573s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6527679a-7f45-45d8-9094-312e115d2bc1 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:49 devstack sudo[88241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6527679a-7f45-45d8-9094-312e115d2bc1 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:18:49 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: deleting Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: deleting {{(pid=83219) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-baeca567-462d-4e7d-80ce-f317e1db3c50" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-baeca567-462d-4e7d-80ce-f317e1db3c50" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Deleting offline snapshot baeca567-462d-4e7d-80ce-f317e1db3c50 of volume 0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] snapshot_file for this snap is: volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2f347-2a5b-4cfd-b857-daec7d590b0e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:49 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e3c5c3e9-e83b-4e53-b964-4e6461de3df8 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-919dd384-e183-40f6-b2ea-20c8fe9fe867-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:49 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 Apr 15 00:18:49 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:49 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6527679a-7f45-45d8-9094-312e115d2bc1 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:49 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 is being set with open permissions: ugo+rw Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:49 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:18:49 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-abc91dac-2030-40b4-8207-9665f81abf71-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-abc91dac-2030-40b4-8207-9665f81abf71-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-abc91dac-2030-40b4-8207-9665f81abf71" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-abc91dac-2030-40b4-8207-9665f81abf71" acquired by "delete_volume" :: waited 0.029s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba5753-c71c-4c1d-a5fd-6c0fe9109cce]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 Apr 15 00:18:50 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:50 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50" returned: 0 in 0.696s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0087aa36-0453-4512-aebe-0429aac7033f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[75620ec4-8631-41f3-bee7-08b9d105f316]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.445s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f Apr 15 00:18:50 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:50 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info Apr 15 00:18:50 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:50 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71" returned: 0 in 0.586s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71 Apr 15 00:18:50 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:50 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f" returned: 0 in 0.536s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 Apr 15 00:18:50 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:50 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info" returned: 0 in 0.548s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:50 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info is being set with open permissions: ugo+rw Apr 15 00:18:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:50 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info Apr 15 00:18:50 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:51 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-abc91dac-2030-40b4-8207-9665f81abf71" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-abc91dac-2030-40b4-8207-9665f81abf71" released by "delete_volume" :: held 1.065s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['b634436c-abcd-4114-8420-43ae316f9d99', '3f9add94-7829-46c8-a94f-7e043548b6c5', '9ff5cdd2-322e-47bc-8fee-c11d00b6dc0f', 'e3ca8edc-54a0-454a-8980-6c16df0dfe95'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:51 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:51 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:51 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:51 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50 Apr 15 00:18:51 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:51 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.info" returned: 0 in 0.615s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.279s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0c00def7-7cfe-46d6-b37e-4f1dcb72898e tempest-VolumesSnapshotTestJSON-343923192 None] Create snapshot completed successfully Apr 15 00:18:51 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.524s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b68c2244-92ab-4b29-9006-cc926659a519 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-abc91dac-2030-40b4-8207-9665f81abf71-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:51 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f.baeca567-462d-4e7d-80ce-f317e1db3c50" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-baeca567-462d-4e7d-80ce-f317e1db3c50" released by "_delete_snapshot" :: held 2.352s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" released by "delete_snapshot" :: held 2.368s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:51 devstack cinder-volume[83219]: WARNING cinder.quota [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1540324028 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1540324028, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:51 devstack cinder-volume[83219]: WARNING cinder.quota [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1540324028 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1540324028, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:51 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['4516b7f1-1e4f-4153-ae90-f726c6311b51', '7850a316-947a-4e9d-8212-d7a1c5291613', 'de89ead9-d161-4f15-8139-1d5e8cf48078', 'cb0beb8e-197d-4d23-8344-68a3cdb2840e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1fc13eec-747f-431c-99eb-ef1189062ecf tempest-GroupSnapshotsTest-1038558844 None] group_snapshot 1e824b07-0a2f-496c-95de-b94760b1ab85: deleted successfully Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b0429-cef7-41ec-9183-b4fc4570784e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:52 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f Apr 15 00:18:52 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (057f5395-f464-44f3-ad49-90912f79c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac47e9d-7f2f-4dd6-962a-1047c816ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac47e9d-7f2f-4dd6-962a-1047c816ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-755874873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ba8a99-4063-4777-a9c4-d40de4a5f322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a43dac0d7e4a2ca384b9a2c5fda993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9724b7c-b394-4af3-92b6-1ca3b80cd573,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:52Z,use_quota=True,user_id='625fc1e613944442b423eb173ad4ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b62a2f-99a7-429a-b7c0-9115290c631d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b62a2f-99a7-429a-b7c0-9115290c631d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc323bb8-6993-4f9e-b905-1d8227cd2c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc323bb8-6993-4f9e-b905-1d8227cd2c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b2ba8a99-4063-4777-a9c4-d40de4a5f322', 'volume_name': 'volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322', 'volume_size': 1, 'snapshot_id': 'a9724b7c-b394-4af3-92b6-1ca3b80cd573'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8abdf-83ce-4797-9698-ec1ad731c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8abdf-83ce-4797-9698-ec1ad731c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcfa109-4531-49e8-ae9e-a03ebdc2eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:52 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Volume b2ba8a99-4063-4777-a9c4-d40de4a5f322: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322', 'volume_size': 1, 'snapshot_id': 'a9724b7c-b394-4af3-92b6-1ca3b80cd573'} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573-b2ba8a99-4063-4777-a9c4-d40de4a5f322" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573-b2ba8a99-4063-4777-a9c4-d40de4a5f322" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Creating volume b2ba8a99-4063-4777-a9c4-d40de4a5f322 from snapshot a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] snapshot: a9724b7c-b394-4af3-92b6-1ca3b80cd573, volume: b2ba8a99-4063-4777-a9c4-d40de4a5f322, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4dadf4-d6f4-4a5f-8a84-2e7cc201ff9c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:52 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:18:52 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:52 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" returned: 0 in 0.612s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" acquired by "delete_volume" :: waited 0.016s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:52 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f Apr 15 00:18:52 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d637b6-db3b-4f64-ad28-770e4f9ad001]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:52 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f Apr 15 00:18:52 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:53 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.554s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6527679a-7f45-45d8-9094-312e115d2bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd0fbf-ab70-494e-8c71-cdfb0e218b31]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:53 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:18:53 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Flow 'volume_create_manager' (aad2c137-36de-45af-a114-4915dc48c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b94e1b-5b30-4e19-b893-26f107e524c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b94e1b-5b30-4e19-b893-26f107e524c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1250440556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56456bf0eed46408eb76f1aede483c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:53Z,use_quota=True,user_id='80ae72527bac40cb908bb92801e0fab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6632412b-9919-446e-b75d-5b93d012652f),volume_type_id=6632412b-9919-446e-b75d-5b93d012652f)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd49e8a1-3c02-4330-836c-995ea15d01ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd49e8a1-3c02-4330-836c-995ea15d01ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad7b75-7f5d-4c65-84af-e5d8e8f9c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad7b75-7f5d-4c65-84af-e5d8e8f9c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4', 'volume_name': 'volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1f1c04-c6f4-4ae4-8ef0-1072717f01ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f1f1c04-c6f4-4ae4-8ef0-1072717f01ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c563e24-c828-4dd2-b7a2-44b7ba308f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Volume 5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4', 'volume_size': 1} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:53 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" returned: 0 in 0.686s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f" released by "delete_volume" :: held 1.326s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['4196bea0-5506-4d83-80a1-1fe0514c0827', 'e1cbc33c-ea41-4275-b30a-2630eca4c76d', '08da762b-d167-47ae-9058-7658ab6d061d', '1601ddd7-3c64-42cd-9e8b-3ece83161ecb'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:53 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f" returned: 0 in 0.673s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:53 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f Apr 15 00:18:53 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:53 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:53 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:53 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.521s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:18:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:53 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 Apr 15 00:18:53 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:54 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0087aa36-0453-4512-aebe-0429aac7033f" returned: 0 in 0.448s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Lock "cinder-quobyte-0087aa36-0453-4512-aebe-0429aac7033f" released by "delete_volume" :: held 1.159s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:54 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:54 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-743136fd-762f-4e38-8021-ec88b4a8b4c1 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-9f9b1dc1-6e28-43f8-b954-e2093ce3e40f-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['8e1c75bf-a130-45f1-9789-71cf63658763'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:54 devstack cinder-volume[83219]: WARNING cinder.quota [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1540324028 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1540324028, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Created reservations ['5f6bd373-c0cd-4788-9d3d-aee02dc35cb7', 'f94f0a19-603a-4c9c-b0da-0c1b8c7c5e3b', '33d710e3-b5f5-4076-8196-56535e9dd9f8', '0bf792f4-e5b6-4fd7-9cdc-dc11e5e0dd05'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:54 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:54 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-32a47253-22d7-4e67-852e-89209f1101a9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-32a47253-22d7-4e67-852e-89209f1101a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "cinder-quobyte-32a47253-22d7-4e67-852e-89209f1101a9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-32a47253-22d7-4e67-852e-89209f1101a9" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f4025-5a66-4624-8a81-e34cf4475cf1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:54 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 Apr 15 00:18:54 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:55 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 1.134s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:55 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:55 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-492b90a1-59e2-4600-9b07-3c0ff0f67c0d tempest-GroupSnapshotsTest-1038558844 None] Delete group completed successfully. Apr 15 00:18:56 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9" returned: 0 in 1.446s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:56 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322" returned: 0 in 2.369s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7dabea-2c28-4161-9a4f-a6c3e99aba9f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:56 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9 Apr 15 00:18:56 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:56 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:18:56 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:56 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-32a47253-22d7-4e67-852e-89209f1101a9" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-quobyte-32a47253-22d7-4e67-852e-89209f1101a9" released by "delete_volume" :: held 1.967s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Created reservations ['9dbd3466-6607-41dd-af78-48c47c55e44c', '777cb6b0-085a-4c56-bfde-3fb1a029c497', '69f0e914-4a7f-439e-afc3-4c8628b8d292', 'fea60730-4977-44c5-80ee-798ffc43db88'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:56 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:56 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:56 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.678s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:18:56 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Converted 1024.00 MB image at 431.62 MB/s Apr 15 00:18:56 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 is being set with open permissions: ugo+rw Apr 15 00:18:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:56 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 Apr 15 00:18:56 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:57 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.534s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Deleted volume successfully. Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c2572302-01eb-4223-8070-6d0f4d77c817 tempest-CreateVolumesFromSourceVolumeTest-1113264179 None] Lock "cinder-32a47253-22d7-4e67-852e-89209f1101a9-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:57 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322" returned: 0 in 0.587s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" released by "_copy_volume_from_snapshot" :: held 4.801s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573-b2ba8a99-4063-4777-a9c4-d40de4a5f322" released by "_create_volume_from_snapshot" :: held 4.823s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.832s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.888s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1250440556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e56456bf0eed46408eb76f1aede483c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:18:53Z,use_quota=True,user_id='80ae72527bac40cb908bb92801e0fab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6632412b-9919-446e-b75d-5b93d012652f),volume_type_id=6632412b-9919-446e-b75d-5b93d012652f)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Creating volume 5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:18:57 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:57 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 1073741824 Apr 15 00:18:57 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcfa109-4531-49e8-ae9e-a03ebdc2eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322', 'volume_size': 1, 'snapshot_id': 'a9724b7c-b394-4af3-92b6-1ca3b80cd573'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c5dd02-8caa-4938-b4c6-d7c67eae7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:57 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Volume volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 (b2ba8a99-4063-4777-a9c4-d40de4a5f322): created successfully Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c5dd02-8caa-4938-b4c6-d7c67eae7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Flow 'volume_create_manager' (057f5395-f464-44f3-ad49-90912f79c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1d94e45a-3f4f-4017-8341-e0e11eda22df tempest-VolumesSnapshotTestJSON-343923192 None] Created volume successfully. Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-b2ba8a99-4063-4777-a9c4-d40de4a5f322-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:58 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 1073741824" returned: 0 in 0.675s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-b2ba8a99-4063-4777-a9c4-d40de4a5f322-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:18:58 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 Apr 15 00:18:58 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ca036-913e-4e24-9052-a04b2c9ca3ec]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:58 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 Apr 15 00:18:58 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:58 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c563e24-c828-4dd2-b7a2-44b7ba308f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a203ae-bdcb-4f69-9924-24c42fb2ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:18:58 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Volume volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 (5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4): created successfully Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a203ae-bdcb-4f69-9924-24c42fb2ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Flow 'volume_create_manager' (aad2c137-36de-45af-a114-4915dc48c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:18:58 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-3be8645e-24d0-4b0d-abd7-e974d3db7b6b tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Created volume successfully. Apr 15 00:18:58 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322" returned: 0 in 0.548s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:58 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322 Apr 15 00:18:58 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:59 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:59 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:59 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b2ba8a99-4063-4777-a9c4-d40de4a5f322" returned: 0 in 0.484s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-b2ba8a99-4063-4777-a9c4-d40de4a5f322" released by "delete_volume" :: held 1.057s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['9c896cfb-9a54-4e86-aab4-e9e2f983f38f', 'f65ffb37-5a92-40dc-8432-993144f6829e', '463690ea-dd89-4943-a4b5-8ceae80201bc', '29ea894d-6d72-4ec2-aab2-82d980c5864d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:18:59 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:18:59 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:18:59 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-738217a7-0eee-4307-8261-70ac8964b81e tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Retype volume completed successfully. Apr 15 00:18:59 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:18:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Deleted volume successfully. Apr 15 00:18:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-21343bf2-5c86-40bc-b02d-010d05ef79ce tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-b2ba8a99-4063-4777-a9c4-d40de4a5f322-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-a9724b7c-b394-4af3-92b6-1ca3b80cd573-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a9724b7c-b394-4af3-92b6-1ca3b80cd573-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Deleting offline snapshot a9724b7c-b394-4af3-92b6-1ca3b80cd573 of volume 6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] snapshot_file for this snap is: volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d3377-31e9-4f6b-a58e-00f6d6bb4439]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "cinder-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "cinder-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "cinder-quobyte-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "cinder-quobyte-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86e93d5-5163-40d1-a2c9-59a2d9d83d61]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:00 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:19:00 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:00 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 Apr 15 00:19:00 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:00 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.527s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6527679a-7f45-45d8-9094-312e115d2bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449984b-8d3a-4d27-b828-b62f224d0911]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:00 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:00 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:19:00 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:01 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4 Apr 15 00:19:01 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:01 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:01 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:19:01 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:01 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "cinder-quobyte-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4" released by "delete_volume" :: held 1.036s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:01 devstack cinder-volume[83219]: WARNING cinder.quota [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:19:01 devstack cinder-volume[83219]: WARNING cinder.quota [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Created reservations ['d9aee420-b695-436b-adfd-706a797deb74', 'ac827325-e09d-4eb5-bbbe-f729067410fd', 'c42f9194-8714-4b29-98bf-d3c092503f3f', '30b26cdd-c3bf-4062-b072-7f0f7ecdae5b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:01 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:01 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:01 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:01 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573 Apr 15 00:19:01 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:02 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Deleted volume successfully. Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-453ffe9b-797a-447b-b6e4-26e1b0abc8b1 tempest-VolumeRetypeWithoutMigrationTest-1666586579 None] Lock "cinder-5ead8ecd-81c8-4a5a-b92b-b6acce25d1c4-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:02 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1.a9724b7c-b394-4af3-92b6-1ca3b80cd573" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-a9724b7c-b394-4af3-92b6-1ca3b80cd573" released by "_delete_snapshot" :: held 2.036s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" released by "delete_snapshot" :: held 2.048s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=263,cinder:INSERT=71,cinder:UPDATE=325,cinder:DELETE=21 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['04d5077b-1ae8-4c6c-8a0c-68c279e58670', '6b1f958d-7dd6-4fb1-8519-5a41df912897', '4f90d0da-36c2-4b07-9c38-0c920e9eb9f9', '5d6c0454-f4f2-43b7-ac49-ca54e8138c5e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Delete snapshot completed successfully. Apr 15 00:19:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-23800936-27df-42f2-9a09-3209c39b8698 tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-a9724b7c-b394-4af3-92b6-1ca3b80cd573-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-6527679a-7f45-45d8-9094-312e115d2bc1-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-6527679a-7f45-45d8-9094-312e115d2bc1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9aed18-24be-4c00-83ec-580b10b650db]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:03 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:19:03 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:04 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.595s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:04 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1 Apr 15 00:19:04 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:04 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6527679a-7f45-45d8-9094-312e115d2bc1" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-6527679a-7f45-45d8-9094-312e115d2bc1" released by "delete_volume" :: held 1.149s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['af9a0022-917d-47c4-a740-395605108de1', 'a22d7282-53d1-42bb-b6b6-3cbc85297d44', '880bc275-89fd-4da8-b173-72aa52913700', 'ab8dd3ab-15c5-4e73-aa9f-f5f31b8891e5'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:04 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:04 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:05 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.500s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Deleted volume successfully. Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c235e4c8-101c-4ae5-9fd1-2d80019ba1fc tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-6527679a-7f45-45d8-9094-312e115d2bc1-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-77d46471-0301-4d7e-ab3c-c21613946c14-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-77d46471-0301-4d7e-ab3c-c21613946c14-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[be52114a-5688-4a99-8cc5-1e2701b39bdd]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:05 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 Apr 15 00:19:05 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Flow 'volume_create_manager' (85516f8b-bf3e-4675-b951-cd16b8165e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36e044-705f-4bde-9fe0-6478bd41f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36e044-705f-4bde-9fe0-6478bd41f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1180325568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d881fd-1e68-4da1-b3fd-466fb68b903e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc322ddbc0548bea812eb0439e8bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:06Z,use_quota=True,user_id='7512eb5aed754a65b632a93dbe8fd971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216a969-c916-4dd1-a35a-d3a73517f26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f216a969-c916-4dd1-a35a-d3a73517f26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615fc624-84d9-4a13-849e-60d7a881f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615fc624-84d9-4a13-849e-60d7a881f572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d881fd-1e68-4da1-b3fd-466fb68b903e', 'volume_name': 'volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed85346-7c98-41f7-95bd-62c518e61541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed85346-7c98-41f7-95bd-62c518e61541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39960d64-beb6-41bd-af76-b5c69dd99f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Volume a7d881fd-1e68-4da1-b3fd-466fb68b903e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e', 'volume_size': 1} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1180325568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d881fd-1e68-4da1-b3fd-466fb68b903e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc322ddbc0548bea812eb0439e8bae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:06Z,use_quota=True,user_id='7512eb5aed754a65b632a93dbe8fd971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Creating volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:06 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:06 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e 1073741824 Apr 15 00:19:06 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:06 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14" returned: 0 in 0.614s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:06 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14 Apr 15 00:19:06 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:06 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e 1073741824" returned: 0 in 0.565s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:07 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e Apr 15 00:19:07 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:07 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-77d46471-0301-4d7e-ab3c-c21613946c14" returned: 0 in 0.514s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-quobyte-77d46471-0301-4d7e-ab3c-c21613946c14" released by "delete_volume" :: held 1.164s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Created reservations ['ebd0ef04-718d-4c65-972b-e92b0182bc3e', 'fbf8de1e-fa1b-4b50-b026-561e2ff100b2', '7fca1c48-aafb-42e7-bbf6-5c1915a65db6', 'bac9d67d-ca58-4d1e-ab78-7cf8d077200e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:07 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:07 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:07 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39960d64-beb6-41bd-af76-b5c69dd99f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c9c89-c986-4f9f-b867-fad61b410649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Volume volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e (a7d881fd-1e68-4da1-b3fd-466fb68b903e): created successfully Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c9c89-c986-4f9f-b867-fad61b410649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Flow 'volume_create_manager' (85516f8b-bf3e-4675-b951-cd16b8165e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8025b042-cacd-47de-810c-2012808702e3 tempest-SnapshotsActionsTest-255651060 None] Created volume successfully. Apr 15 00:19:07 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.485s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Deleted volume successfully. Apr 15 00:19:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-661c22a8-0229-402f-8750-a1184960d05d tempest-VolumesSnapshotTestJSON-343923192 None] Lock "cinder-77d46471-0301-4d7e-ab3c-c21613946c14-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Creating offline snapshot 2c802fc8-4cc5-4d4e-a4e9-31b139ef280b of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:08 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cca1c3-5b14-4992-8bcf-2caeca32e326]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:08 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e Apr 15 00:19:08 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Flow 'volume_create_manager' (b42e59e8-e068-4d91-a8d0-03d7b5e42aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1998b65c-937a-44c4-9cd2-9a3415d214dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1998b65c-937a-44c4-9cd2-9a3415d214dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-502004295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baba19e6-09bf-4eb7-8b5d-beb53e9b46e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c894e7a9f3754227a9f0384d76a23ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:09Z,use_quota=True,user_id='6f9395afa67d461c82b37dd90cc66713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b04583-5ad6-4d7e-b2e3-55d0dfd70429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b04583-5ad6-4d7e-b2e3-55d0dfd70429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723b5802-8aff-4516-9296-f5144de1293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.image.glance [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Creating Keystone auth plugin from conf {{(pid=83219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 00:19:09 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e" returned: 0 in 0.658s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:09 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b 1G Apr 15 00:19:09 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723b5802-8aff-4516-9296-f5144de1293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'baba19e6-09bf-4eb7-8b5d-beb53e9b46e9', 'volume_name': 'volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7387d68-19d3-46fc-a292-115e5d5f50c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7387d68-19d3-46fc-a292-115e5d5f50c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8c58d-101d-49b1-aea8-1455e1d7807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Trying to clone baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 from image bb201dba-017f-4c90-9496-4d9f4a01c76f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]). {{(pid=83219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 00:19:09 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Image download 20.69 MB at 20.69 MB/s Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4a979-c5d0-4009-b837-bc09edd28490]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:09 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD Apr 15 00:19:09 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:09 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b 1G" returned: 0 in 0.588s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:09 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:09 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:10 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f is fetched for user 6f9395afa67d461c82b37dd90cc66713. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a67f5-ea06-4c3c-a40b-df5bf6580c56]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:10 devstack sudo[88455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD Apr 15 00:19:10 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:10 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.529s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:10 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b is being set with open permissions: ugo+rw Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:10 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:10 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:10 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:10 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:11 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info Apr 15 00:19:11 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:11 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:11 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info is being set with open permissions: ugo+rw Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:11 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info Apr 15 00:19:11 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:11 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.info" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.987s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-502004295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baba19e6-09bf-4eb7-8b5d-beb53e9b46e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c894e7a9f3754227a9f0384d76a23ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:09Z,use_quota=True,user_id='6f9395afa67d461c82b37dd90cc66713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Creating volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:11 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-dbe1d1ff-a8e9-401a-83ab-6b7dcd39ea3f tempest-SnapshotsActionsTest-255651060 None] Create snapshot completed successfully Apr 15 00:19:11 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1073741824 Apr 15 00:19:11 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Flow 'volume_create_manager' (c4eaab48-0ab8-4af7-98f4-705a6be482f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa700913-35e1-42b8-80f9-b98b0c77c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa700913-35e1-42b8-80f9-b98b0c77c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-727929888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be815f55-2159-4590-a88f-a78c9fadaecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148217b95a74f7eb878ceb4cb03dab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:12Z,use_quota=True,user_id='cedb700661724c66b5bdf9225b2508c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e06bd-eec8-44cd-b6aa-1292da9ceff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e06bd-eec8-44cd-b6aa-1292da9ceff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b09fc0-3eba-4c63-8caa-a6ef5091e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b09fc0-3eba-4c63-8caa-a6ef5091e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be815f55-2159-4590-a88f-a78c9fadaecf', 'volume_name': 'volume-be815f55-2159-4590-a88f-a78c9fadaecf', 'volume_size': 2}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e090d3-7468-4ebf-a80d-b6556c474876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e090d3-7468-4ebf-a80d-b6556c474876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9086502-f8dc-4a91-aef4-4c465959be62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Volume be815f55-2159-4590-a88f-a78c9fadaecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be815f55-2159-4590-a88f-a78c9fadaecf', 'volume_size': 2} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:12 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1073741824" returned: 0 in 0.547s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:12 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:12 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:12 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-727929888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be815f55-2159-4590-a88f-a78c9fadaecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f148217b95a74f7eb878ceb4cb03dab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:12Z,use_quota=True,user_id='cedb700661724c66b5bdf9225b2508c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Creating volume be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:12 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf 2147483648 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:12 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf 2147483648 Apr 15 00:19:12 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Attempting download of bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c77d9e-a8c1-4566-a25b-e35bc23027b8]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:13 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t Apr 15 00:19:13 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:13 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf 2147483648" returned: 0 in 0.559s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:13 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:13 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf Apr 15 00:19:13 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t" returned: 0 in 0.518s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:13 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t Apr 15 00:19:13 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:13 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf" returned: 0 in 0.408s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.762s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9086502-f8dc-4a91-aef4-4c465959be62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be815f55-2159-4590-a88f-a78c9fadaecf', 'volume_size': 2}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c618f94-9a63-456a-a052-255c13cafab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Volume volume-be815f55-2159-4590-a88f-a78c9fadaecf (be815f55-2159-4590-a88f-a78c9fadaecf): created successfully Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c618f94-9a63-456a-a052-255c13cafab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Flow 'volume_create_manager' (c4eaab48-0ab8-4af7-98f4-705a6be482f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Creating offline snapshot 8d13d044-aa48-4a39-8fa1-9c0b568996fb of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fb680847-9c84-4db2-a713-0b19c274a9ec tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Created volume successfully. Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[76016337-16fc-4420-82eb-c93b9c97eca8]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:14 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t" returned: 1 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_v3r5eu5t' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[625de99b-bbc2-4dcb-b06b-34434d635f02]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:14 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:14 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:14 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD Apr 15 00:19:14 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:14 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] bb201dba-017f-4c90-9496-4d9f4a01c76f was qcow2, converting to raw {{(pid=83219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:14 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:14 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:14 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:14 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb 1G Apr 15 00:19:14 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:15 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb 1G" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:15 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb Apr 15 00:19:15 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:15 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 0 in 0.858s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f__m8x0k0fdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:19:15 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:15 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1G Apr 15 00:19:15 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:15 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:15 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb is being set with open permissions: ugo+rw Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:15 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb Apr 15 00:19:15 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:15 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 1G" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece57a12-cf12-4053-adf5-d63c11645012]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:15 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb" returned: 0 in 0.403s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.967s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.420s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:15 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:15 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Creating offline snapshot 6e23e98a-43ba-440e-9da3-ebdc4b716b93 of volume be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:15 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a4ddc5de-56b4-4eed-8f09-e84ae6db3333 tempest-SnapshotsActionsTest-255651060 None] Create snapshot completed successfully Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1d0bc-f3d0-44a6-b685-5a99376cab79]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf Apr 15 00:19:16 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:16 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-8d13d044-aa48-4a39-8fa1-9c0b568996fb-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-8d13d044-aa48-4a39-8fa1-9c0b568996fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:16 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:16 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-8d13d044-aa48-4a39-8fa1-9c0b568996fb" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-8d13d044-aa48-4a39-8fa1-9c0b568996fb" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Deleting offline snapshot 8d13d044-aa48-4a39-8fa1-9c0b568996fb of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] snapshot_file for this snap is: volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f133bee1-871f-4199-831b-3e75943318e4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 2G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 2G Apr 15 00:19:16 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:16 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb Apr 15 00:19:16 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:16 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 1 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Downloaded image bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 successfully. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f for user 6f9395afa67d461c82b37dd90cc66713 is deleted. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Marking volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 as bootable. {{(pid=83219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Copying metadata from image bb201dba-017f-4c90-9496-4d9f4a01c76f to baba19e6-09bf-4eb7-8b5d-beb53e9b46e9. {{(pid=83219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Creating volume glance metadata for volume baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 backed by image bb201dba-017f-4c90-9496-4d9f4a01c76f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8c58d-101d-49b1-aea8-1455e1d7807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0bc635-9536-4908-824c-87a4a41e444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Volume volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 (baba19e6-09bf-4eb7-8b5d-beb53e9b46e9): created successfully Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0bc635-9536-4908-824c-87a4a41e444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Flow 'volume_create_manager' (b42e59e8-e068-4d91-a8d0-03d7b5e42aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-df00ae2b-fb1e-4c50-94a4-ac7928f4869d tempest-VolumesImageMetadata-1541160656 None] Created volume successfully. Apr 15 00:19:16 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 2G" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be815f55-2159-4590-a88f-a78c9fadaecf -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb" returned: 0 in 0.531s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b081cbf-1649-4076-9382-0968b9657c0e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:16 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be815f55-2159-4590-a88f-a78c9fadaecf -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 Apr 15 00:19:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:16 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:17 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:17 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:17 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be815f55-2159-4590-a88f-a78c9fadaecf -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:17 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 is being set with open permissions: ugo+rw Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:17 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 Apr 15 00:19:17 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:17 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:17 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb Apr 15 00:19:17 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:17 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Acquiring lock "cinder-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:17 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info Apr 15 00:19:17 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "cinder-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Acquiring lock "cinder-quobyte-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:17 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb" returned: 0 in 0.509s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "cinder-quobyte-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" acquired by "delete_volume" :: waited 0.024s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:18 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb Apr 15 00:19:18 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0d0d7f-425c-4faa-b23b-a05b4a544a07]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:18 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:18 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:18 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:18 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info is being set with open permissions: ugo+rw Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:18 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info Apr 15 00:19:18 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:18 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.8d13d044-aa48-4a39-8fa1-9c0b568996fb" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-8d13d044-aa48-4a39-8fa1-9c0b568996fb" released by "_delete_snapshot" :: held 2.012s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_snapshot" :: held 2.028s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Created reservations ['1d86420b-c696-4118-b948-1be50cf5029a', '6f3b875e-70f5-4649-8e72-bffdc9deea91', 'fe2824ea-a45f-45ae-b968-5f8b3ccb3373', '612a0a15-6506-4ce9-9e6b-4aded78bd3eb'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Delete snapshot completed successfully. Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e0ec8fa7-6f7c-411f-8077-7e78c2fb2d57 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-8d13d044-aa48-4a39-8fa1-9c0b568996fb-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:18 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 0 in 0.505s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:18 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:18 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:18 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.info" returned: 0 in 0.445s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.901s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1d8dfaa8-017c-4b52-9374-3cf87ebd8eb9 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Create snapshot completed successfully Apr 15 00:19:19 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 1 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:19 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9 Apr 15 00:19:19 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:19 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "cinder-quobyte-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9" released by "delete_volume" :: held 1.439s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Created reservations ['ccd555f7-5cdb-4d7b-97d5-cced87a3addb', 'cd07aee3-68b0-4816-ab9e-79b21c3c0f74', 'cc2cfda3-c44f-46b6-8fa1-5c3767ddeb4c', '1ef091b2-c18f-4c4e-bea9-fc26661b534d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:19 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:19 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "cinder-6e23e98a-43ba-440e-9da3-ebdc4b716b93-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-6e23e98a-43ba-440e-9da3-ebdc4b716b93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "cinder-quobyte-6e23e98a-43ba-440e-9da3-ebdc4b716b93" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-6e23e98a-43ba-440e-9da3-ebdc4b716b93" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Deleting offline snapshot 6e23e98a-43ba-440e-9da3-ebdc4b716b93 of volume be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] snapshot_file for this snap is: volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Creating offline snapshot 37528c88-3d6c-46a8-95a3-7e0fbc5667a0 of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77cfe87-cb33-4648-b527-c80241569fa6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d52cb-d21e-4595-a370-9d456f7e80e9]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:19 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 Apr 15 00:19:19 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:19 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:19 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:19 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.445s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:19 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Deleted volume successfully. Apr 15 00:19:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4c99736a-5b03-4c94-a8fd-23f718085512 tempest-VolumesImageMetadata-1541160656 None] Lock "cinder-baba19e6-09bf-4eb7-8b5d-beb53e9b46e9-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:20 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be815f55-2159-4590-a88f-a78c9fadaecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a41234-df8f-4652-9b87-356c757194d4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:20 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:20 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 1G Apr 15 00:19:20 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:20 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf Apr 15 00:19:20 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:20 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf" returned: 0 in 0.572s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:20 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 Apr 15 00:19:20 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:21 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 1G" returned: 0 in 0.621s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:21 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 Apr 15 00:19:21 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:21 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:21 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93 Apr 15 00:19:21 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:21 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:21 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 is being set with open permissions: ugo+rw Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:21 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 Apr 15 00:19:21 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (48f080c5-53d0-4c20-8fe4-b413ab21df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc10ac69-f899-48ef-80da-26dc9937fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc10ac69-f899-48ef-80da-26dc9937fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-284583585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49a6fe057b7467b80fe7046c4d86c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:22Z,use_quota=True,user_id='8f235b47063947c1bf35c4a7212aaba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e11598-0cc2-4a03-a539-caf1e47134b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e11598-0cc2-4a03-a539-caf1e47134b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acff507-d529-40d6-9655-1b18d2e6be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9acff507-d529-40d6-9655-1b18d2e6be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8', 'volume_name': 'volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d884fdb-2eee-4623-a125-14d8bac6bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d884fdb-2eee-4623-a125-14d8bac6bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f9daa-df3d-4601-a350-9baeca3af6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8', 'volume_size': 1} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:21 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf.6e23e98a-43ba-440e-9da3-ebdc4b716b93" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-6e23e98a-43ba-440e-9da3-ebdc4b716b93" released by "_delete_snapshot" :: held 2.099s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" released by "delete_snapshot" :: held 2.121s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:21 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-284583585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49a6fe057b7467b80fe7046c4d86c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:22Z,use_quota=True,user_id='8f235b47063947c1bf35c4a7212aaba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Creating volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:21 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:21 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 1073741824 Apr 15 00:19:21 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6bbbf030-be34-49e5-aea5-a7d67a5ba142 tempest-SnapshotsActionsTest-255651060 None] Create snapshot completed successfully Apr 15 00:19:21 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Created reservations ['a081403f-b5aa-445f-9174-4e1adfa44bfd', '7dd56cad-65f5-424d-b9ef-215a52d12cfd', 'c49534fa-c0b0-4574-b26f-bb6b5b62437a', '4e1d3808-13a5-48f9-bd38-27d89783431a'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Delete snapshot completed successfully. Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-50d2bca7-1814-468d-a932-c71bd6123d69 tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-6e23e98a-43ba-440e-9da3-ebdc4b716b93-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:22 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 1073741824" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:22 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 Apr 15 00:19:22 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:22 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2f9daa-df3d-4601-a350-9baeca3af6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affe5b6c-36ee-430d-a234-83433fcc8ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:22 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Volume volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 (08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8): created successfully Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affe5b6c-36ee-430d-a234-83433fcc8ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (48f080c5-53d0-4c20-8fe4-b413ab21df73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d9067395-7de6-49d3-a1ea-7804be0ffd80 tempest-VolumesDeleteCascade-425959162 None] Created volume successfully. Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "cinder-be815f55-2159-4590-a88f-a78c9fadaecf-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-be815f55-2159-4590-a88f-a78c9fadaecf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-37528c88-3d6c-46a8-95a3-7e0fbc5667a0-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-37528c88-3d6c-46a8-95a3-7e0fbc5667a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" acquired by "delete_volume" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-37528c88-3d6c-46a8-95a3-7e0fbc5667a0" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b952feda-fa8c-4131-81fa-3dec1b35c9a0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-37528c88-3d6c-46a8-95a3-7e0fbc5667a0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Deleting offline snapshot 37528c88-3d6c-46a8-95a3-7e0fbc5667a0 of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] snapshot_file for this snap is: volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee92d2e-79a9-411d-ac8b-cbcddc6fe115]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:23 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf Apr 15 00:19:23 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:23 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 Apr 15 00:19:23 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:23 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:23 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0" returned: 0 in 0.484s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:23 devstack sudo[88658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf Apr 15 00:19:23 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ed1ab7-6048-4f05-81ca-0389759640e0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:23 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:23 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Creating offline snapshot f11a5980-b126-49f7-952e-f0ea8067a3c8 of volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b132b3-50ee-4962-b55b-6f135cae455d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-be815f55-2159-4590-a88f-a78c9fadaecf" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 Apr 15 00:19:24 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-quobyte-be815f55-2159-4590-a88f-a78c9fadaecf" released by "delete_volume" :: held 1.018s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Created reservations ['7974f770-cfd0-4c33-b852-3d1680860fa3', 'b8f9c5ae-3ade-4ebf-92b2-aed7a213cac9', '40f0fe36-5127-4e4e-bc99-bd9950e7b365', '0d62c645-3da1-436b-9fb6-c37e5b06a562'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:24 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 Apr 15 00:19:24 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:24 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" returned: 0 in 0.501s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 1G Apr 15 00:19:24 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.429s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:24 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Deleted volume successfully. Apr 15 00:19:24 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0 Apr 15 00:19:24 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a7ce91dc-a5b9-4710-a981-e7c71fe2929d tempest-VolumesSnapshotNegativeTestJSON-1279554315 None] Lock "cinder-be815f55-2159-4590-a88f-a78c9fadaecf-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:24 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 1G" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:24 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:24 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.37528c88-3d6c-46a8-95a3-7e0fbc5667a0" returned: 0 in 0.419s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:24 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-37528c88-3d6c-46a8-95a3-7e0fbc5667a0" released by "_delete_snapshot" :: held 1.918s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_snapshot" :: held 1.940s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Created reservations ['c3813024-b6d4-4e40-9325-37bc505eb4ec', '4fb5082b-5732-4155-a26d-4eba53248654', '4893c3f1-1d36-4ab9-a423-7dab96725abc', '52731baf-bbf6-4c69-ac7e-5bfb242099d7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Delete snapshot completed successfully. Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a81dba88-e400-45c0-9bd1-e055af34b72c tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-37528c88-3d6c-46a8-95a3-7e0fbc5667a0-delete_snapshot" released by "delete_snapshot" :: held 2.049s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:25 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:25 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 is being set with open permissions: ugo+rw Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:25 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:25 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:25 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:25 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info Apr 15 00:19:25 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:26 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:26 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info is being set with open permissions: ugo+rw Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:26 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info Apr 15 00:19:26 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (6b15a754-2ac9-4f77-9fb9-a56deb37ace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31541ac-f694-4a86-b30f-30c328fb7291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31541ac-f694-4a86-b30f-30c328fb7291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407878242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cecafb6-71c8-4160-9ce4-e37ccd1f7b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ccc96e-92c4-4a1c-9844-fb259f7c5149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ccc96e-92c4-4a1c-9844-fb259f7c5149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2ef03d-42e0-46b3-85bc-00561b851c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2ef03d-42e0-46b3-85bc-00561b851c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cecafb6-71c8-4160-9ce4-e37ccd1f7b58', 'volume_name': 'volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3610e6e-df86-4898-ab77-134363d8c0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3610e6e-df86-4898-ab77-134363d8c0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39427b49-cac6-40f1-b07e-6b15ce095b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Volume 7cecafb6-71c8-4160-9ce4-e37ccd1f7b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58', 'volume_size': 1} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:26 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.info" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.591s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Creating offline snapshot 6d17d78a-f2ce-40ed-8eb3-9de9702a910c of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-656c3d3a-8d09-49f8-ac6a-0506fe66c328 tempest-VolumesDeleteCascade-425959162 None] Create snapshot completed successfully Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dcff9b-e299-4009-9a94-9ea6c0d30338]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (c13c0cee-ee0b-494b-91ee-f60007deefb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a890474-abe4-4433-bd55-0107edede4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a890474-abe4-4433-bd55-0107edede4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57272707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e0819-8955-4423-b16f-c504a2f6b8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72386c1b-69ed-4a4f-8974-892be86783b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72386c1b-69ed-4a4f-8974-892be86783b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e5776-80a5-4b3b-b509-e4dabf2f2311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e5776-80a5-4b3b-b509-e4dabf2f2311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20e0819-8955-4423-b16f-c504a2f6b8d1', 'volume_name': 'volume-c20e0819-8955-4423-b16f-c504a2f6b8d1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:27 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad72bdb-fec1-4842-8696-9f481c6edb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad72bdb-fec1-4842-8696-9f481c6edb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa144eb-9714-47bb-88e8-02f1d79df523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Volume c20e0819-8955-4423-b16f-c504a2f6b8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20e0819-8955-4423-b16f-c504a2f6b8d1', 'volume_size': 1} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (77e0bbcc-2f9c-4c93-91fe-8fd05500ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bcfc97-49c8-4644-ba90-157a8542cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bcfc97-49c8-4644-ba90-157a8542cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779462516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc23b46-dbd8-4331-b044-facc13a34945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb73859-61ee-4350-9934-b76a9358d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb73859-61ee-4350-9934-b76a9358d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56148b2d-4c69-476c-bf96-25a127799a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56148b2d-4c69-476c-bf96-25a127799a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc23b46-dbd8-4331-b044-facc13a34945', 'volume_name': 'volume-3bc23b46-dbd8-4331-b044-facc13a34945', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54144a66-1654-4f90-9fb5-55a9e3af27f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54144a66-1654-4f90-9fb5-55a9e3af27f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb0a3ff-22a3-4b03-b3e2-3b137ec81363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Volume 3bc23b46-dbd8-4331-b044-facc13a34945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc23b46-dbd8-4331-b044-facc13a34945', 'volume_size': 1} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (dec5f92b-b89f-4703-be47-32153634a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2cdd3f-4b04-459f-b681-6961419526d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2cdd3f-4b04-459f-b681-6961419526d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8688883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40fe21c-97d1-4eba-968b-4adf7cb5388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeab587-e57c-404e-87d9-d12522b4f055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddeab587-e57c-404e-87d9-d12522b4f055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30127aa4-d1a7-4aab-b757-a80b4f525c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30127aa4-d1a7-4aab-b757-a80b4f525c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40fe21c-97d1-4eba-968b-4adf7cb5388d', 'volume_name': 'volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580ab3b7-5671-4832-b1bd-023b72f12f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580ab3b7-5671-4832-b1bd-023b72f12f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18865e57-a3b0-48a8-a9e0-5a775cf03283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Volume c40fe21c-97d1-4eba-968b-4adf7cb5388d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d', 'volume_size': 1} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (f1df62a7-d9a1-434f-a2d7-ad3a0da55bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f864d-17b8-4e58-8c48-8de3063497c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f864d-17b8-4e58-8c48-8de3063497c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73638243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ab1bf2-f0f8-443c-9722-90741bac5982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:28Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c2fca-21f6-4ac4-9449-8727a4749487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130c2fca-21f6-4ac4-9449-8727a4749487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec81ee7-a37c-48f4-a6dc-f135ec9b285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec81ee7-a37c-48f4-a6dc-f135ec9b285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ab1bf2-f0f8-443c-9722-90741bac5982', 'volume_name': 'volume-c0ab1bf2-f0f8-443c-9722-90741bac5982', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c6252-b369-48dd-847f-cb58ea5ff623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c6252-b369-48dd-847f-cb58ea5ff623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3618c9ac-5616-4db3-9ef3-23d699cbb8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Volume c0ab1bf2-f0f8-443c-9722-90741bac5982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ab1bf2-f0f8-443c-9722-90741bac5982', 'volume_size': 1} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.659s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:27 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c 1G Apr 15 00:19:27 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:28 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c 1G" returned: 0 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:28 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c Apr 15 00:19:28 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:28 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:28 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c is being set with open permissions: ugo+rw Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:28 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c Apr 15 00:19:28 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:28 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c" returned: 0 in 0.393s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407878242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cecafb6-71c8-4160-9ce4-e37ccd1f7b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Creating volume 7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:28 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:28 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 1073741824 Apr 15 00:19:28 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-785d0103-501d-4b83-9565-78756df3adc0 tempest-SnapshotsActionsTest-255651060 None] Create snapshot completed successfully Apr 15 00:19:29 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 1073741824" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:29 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 Apr 15 00:19:29 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-6d17d78a-f2ce-40ed-8eb3-9de9702a910c-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-6d17d78a-f2ce-40ed-8eb3-9de9702a910c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-6d17d78a-f2ce-40ed-8eb3-9de9702a910c" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-6d17d78a-f2ce-40ed-8eb3-9de9702a910c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Deleting offline snapshot 6d17d78a-f2ce-40ed-8eb3-9de9702a910c of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] snapshot_file for this snap is: volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5187b2b-b793-400c-8951-bae9267f8e2d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:29 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c Apr 15 00:19:29 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:29 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" returned: 0 in 0.420s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57272707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e0819-8955-4423-b16f-c504a2f6b8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Creating volume c20e0819-8955-4423-b16f-c504a2f6b8d1 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:29 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39427b49-cac6-40f1-b07e-6b15ce095b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88fbcc6-5717-4a3b-8f55-de79d2f47398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:29 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 1073741824 Apr 15 00:19:29 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Volume volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 (7cecafb6-71c8-4160-9ce4-e37ccd1f7b58): created successfully Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f88fbcc6-5717-4a3b-8f55-de79d2f47398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (6b15a754-2ac9-4f77-9fb9-a56deb37ace9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2f630708-5926-43b8-9cb2-ee5b9be6cb3d tempest-CreateVolumesFromImageTest-295909669 None] Created volume successfully. Apr 15 00:19:30 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c4107-cbac-4918-ab40-c443d02fd4d6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:30 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:30 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:30 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 1073741824" returned: 0 in 0.497s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:30 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 Apr 15 00:19:30 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:30 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:30 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c Apr 15 00:19:30 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:30 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1" returned: 0 in 0.412s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779462516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc23b46-dbd8-4331-b044-facc13a34945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Creating volume 3bc23b46-dbd8-4331-b044-facc13a34945 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:30 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa144eb-9714-47bb-88e8-02f1d79df523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20e0819-8955-4423-b16f-c504a2f6b8d1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:30 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 1073741824 Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16010475-3ae9-49ad-bae3-7ea418a5b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:30 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:30 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Volume volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 (c20e0819-8955-4423-b16f-c504a2f6b8d1): created successfully Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16010475-3ae9-49ad-bae3-7ea418a5b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (c13c0cee-ee0b-494b-91ee-f60007deefb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:30 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bbf400f6-efb4-4f66-84c3-732fbaf1fbca tempest-CreateVolumesFromImageTest-295909669 None] Created volume successfully. Apr 15 00:19:31 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:31 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c Apr 15 00:19:31 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:31 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 1073741824" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:31 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 Apr 15 00:19:31 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:31 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.6d17d78a-f2ce-40ed-8eb3-9de9702a910c" returned: 0 in 0.415s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-6d17d78a-f2ce-40ed-8eb3-9de9702a910c" released by "_delete_snapshot" :: held 1.908s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_snapshot" :: held 1.920s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Created reservations ['5cf0efc1-7dc8-4331-882f-f02952f81c3d', 'f4f45213-865d-4623-b06c-1690b875a487', '94c955a5-e067-4b9c-aa3d-25d2f994cbf1', 'fd629e02-fbc8-4b3d-8814-c7ad131165de'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Delete snapshot completed successfully. Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-55e7f158-4081-4a3b-a482-1f660663508d tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-6d17d78a-f2ce-40ed-8eb3-9de9702a910c-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:31 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.534s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Creating offline snapshot 8936a838-b8d9-461b-8041-b7d760e31356 of volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb0a3ff-22a3-4b03-b3e2-3b137ec81363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc23b46-dbd8-4331-b044-facc13a34945', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524ccbc1-d50b-4d7f-98ff-542a9292057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5c78a5-e616-4c8e-9c0f-a389f22492ed]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Volume volume-3bc23b46-dbd8-4331-b044-facc13a34945 (3bc23b46-dbd8-4331-b044-facc13a34945): created successfully Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524ccbc1-d50b-4d7f-98ff-542a9292057c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (77e0bbcc-2f9c-4c93-91fe-8fd05500ae01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bb37578b-e0c3-4af7-89f7-5dfa222dfaea tempest-CreateVolumesFromImageTest-295909669 None] Created volume successfully. Apr 15 00:19:31 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:31 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:32 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:32 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 1G Apr 15 00:19:32 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:32 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 1G" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:32 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 Apr 15 00:19:32 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:33 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356" returned: 0 in 0.428s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:33 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 is being set with open permissions: ugo+rw Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:33 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 Apr 15 00:19:33 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:33 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356" returned: 0 in 0.415s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.271s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8688883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40fe21c-97d1-4eba-968b-4adf7cb5388d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:27Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Creating volume c40fe21c-97d1-4eba-968b-4adf7cb5388d {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:33 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:33 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d 1073741824 Apr 15 00:19:33 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:33 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-597fac10-cf81-48bb-82ca-2b6a30a5435f tempest-VolumesDeleteCascade-425959162 None] Create snapshot completed successfully Apr 15 00:19:33 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=237,cinder:INSERT=81,cinder:UPDATE=275,cinder:DELETE=23 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:19:34 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d 1073741824" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:34 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d Apr 15 00:19:34 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Performing cascade delete. {{(pid=83219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-8936a838-b8d9-461b-8041-b7d760e31356-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-8936a838-b8d9-461b-8041-b7d760e31356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-8936a838-b8d9-461b-8041-b7d760e31356" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-8936a838-b8d9-461b-8041-b7d760e31356" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Deleting offline snapshot 8936a838-b8d9-461b-8041-b7d760e31356 of volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] snapshot_file for this snap is: volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3815eb8-0acf-43d4-ba71-e0a9e50346d6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:34 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 Apr 15 00:19:34 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:34 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.062s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73638243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ab1bf2-f0f8-443c-9722-90741bac5982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d982989bb145ffa13cca2716f4a30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:28Z,use_quota=True,user_id='6757caa6029b40f0abb8c526d72af38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Creating volume c0ab1bf2-f0f8-443c-9722-90741bac5982 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:34 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18865e57-a3b0-48a8-a9e0-5a775cf03283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eb1db7-4d34-42d6-8bd6-e2d6099cb56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:34 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 1073741824 Apr 15 00:19:34 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:34 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Volume volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d (c40fe21c-97d1-4eba-968b-4adf7cb5388d): created successfully Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eb1db7-4d34-42d6-8bd6-e2d6099cb56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (dec5f92b-b89f-4703-be47-32153634a313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-803fabfc-5594-4ec5-a80e-b70370290caf tempest-CreateVolumesFromImageTest-295909669 None] Created volume successfully. Apr 15 00:19:35 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab84230-2756-4d44-ad8f-a94c25f6844a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:35 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:35 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:35 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 1073741824" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:35 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 Apr 15 00:19:35 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:35 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:35 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 Apr 15 00:19:35 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:35 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982" returned: 0 in 0.409s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.767s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3618c9ac-5616-4db3-9ef3-23d699cbb8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ab1bf2-f0f8-443c-9722-90741bac5982', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b7dc75-b070-49f2-abe0-c098fb74438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:35 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Volume volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 (c0ab1bf2-f0f8-443c-9722-90741bac5982): created successfully Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b7dc75-b070-49f2-abe0-c098fb74438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Flow 'volume_create_manager' (f1df62a7-d9a1-434f-a2d7-ad3a0da55bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Creating offline snapshot 2df96bba-a522-49d7-9db7-d3cb46efbd31 of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f961ba06-0a2d-409c-84ac-934f7d4bb3cf tempest-CreateVolumesFromImageTest-295909669 None] Created volume successfully. Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaf12a6-c675-4bc9-88f9-69af02a749b7]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:35 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:35 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356 Apr 15 00:19:36 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-c0ab1bf2-f0f8-443c-9722-90741bac5982-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c0ab1bf2-f0f8-443c-9722-90741bac5982-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-quobyte-c0ab1bf2-f0f8-443c-9722-90741bac5982" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c0ab1bf2-f0f8-443c-9722-90741bac5982" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3735f0-d927-4154-a023-2efaea4a9089]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.547s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 1G Apr 15 00:19:36 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 Apr 15 00:19:36 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.8936a838-b8d9-461b-8041-b7d760e31356" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-8936a838-b8d9-461b-8041-b7d760e31356" released by "_delete_snapshot" :: held 1.969s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" released by "delete_snapshot" :: held 1.980s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Created reservations ['ca58136e-502a-4a26-8abd-077487929846', '1b0a157a-f360-4110-ac87-08e025b6069d', '6d239526-adf1-4617-8283-af1f0129e353', 'be24b115-a1fd-4afd-aaf9-cd093a158b12'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Delete snapshot completed successfully. Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-8936a838-b8d9-461b-8041-b7d760e31356-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-f11a5980-b126-49f7-952e-f0ea8067a3c8-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-f11a5980-b126-49f7-952e-f0ea8067a3c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-f11a5980-b126-49f7-952e-f0ea8067a3c8" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-f11a5980-b126-49f7-952e-f0ea8067a3c8" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Deleting offline snapshot f11a5980-b126-49f7-952e-f0ea8067a3c8 of volume 08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] snapshot_file for this snap is: volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[619814a8-61a8-4449-b7cc-b8b7150b9f10]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982 Apr 15 00:19:36 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 1G" returned: 0 in 0.525s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:36 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:36 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:36 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 Apr 15 00:19:36 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c0ab1bf2-f0f8-443c-9722-90741bac5982" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c0ab1bf2-f0f8-443c-9722-90741bac5982" released by "delete_volume" :: held 0.952s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Created reservations ['60fffa40-7123-4224-ac8d-ba2b91693a2f', 'c308566f-7181-44a3-8756-f682dde24ad3', '5377a67f-313b-4e3d-b45d-5aed15976b9b', '7cf8556d-bd63-415c-8fa5-cfb1acb242b7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:37 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.519s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:37 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 is being set with open permissions: ugo+rw Apr 15 00:19:37 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c39801b-b541-4648-9c14-c99798924487]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 Apr 15 00:19:37 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-c40fe21c-97d1-4eba-968b-4adf7cb5388d-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c40fe21c-97d1-4eba-968b-4adf7cb5388d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-quobyte-c40fe21c-97d1-4eba-968b-4adf7cb5388d" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:37 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 Apr 15 00:19:37 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c40fe21c-97d1-4eba-968b-4adf7cb5388d" acquired by "delete_volume" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e06d461-484f-4503-8c64-c4f4392f987f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d Apr 15 00:19:37 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.414s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Deleted volume successfully. Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-d6618a58-eae7-4185-b6b4-2e20872457a8 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c0ab1bf2-f0f8-443c-9722-90741bac5982-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:37 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8a431055-1032-4be8-a17a-4eb5748e12d9 tempest-SnapshotsActionsTest-255651060 None] Create snapshot completed successfully Apr 15 00:19:37 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" returned: 0 in 0.543s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:37 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:37 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:37 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d Apr 15 00:19:37 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-2df96bba-a522-49d7-9db7-d3cb46efbd31-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-2df96bba-a522-49d7-9db7-d3cb46efbd31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Acquiring lock "cinder-quobyte-2df96bba-a522-49d7-9db7-d3cb46efbd31" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-2df96bba-a522-49d7-9db7-d3cb46efbd31" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Deleting offline snapshot 2df96bba-a522-49d7-9db7-d3cb46efbd31 of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] snapshot_file for this snap is: volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d4a2e7-7a12-46ee-9ed5-480a6ef84e79]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 Apr 15 00:19:38 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c40fe21c-97d1-4eba-968b-4adf7cb5388d" returned: 0 in 0.437s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c40fe21c-97d1-4eba-968b-4adf7cb5388d" released by "delete_volume" :: held 0.952s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:38 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8 Apr 15 00:19:38 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Created reservations ['e1818c8d-8843-4c3a-b1ea-fdefbf612fed', 'e2004472-f5e2-4e40-9151-528d179a452f', 'af787b22-b706-4b7c-be3c-1115e357c41e', 'e8b8d003-7f1c-4577-9c0e-4111572140f5'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:38 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-3bc23b46-dbd8-4331-b044-facc13a34945-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-3bc23b46-dbd8-4331-b044-facc13a34945-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-quobyte-3bc23b46-dbd8-4331-b044-facc13a34945" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-3bc23b46-dbd8-4331-b044-facc13a34945" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[338598db-e6e2-4630-aa47-922d1279b103]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 Apr 15 00:19:38 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676301e-6777-4904-a595-6f5e905259c1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8.f11a5980-b126-49f7-952e-f0ea8067a3c8" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-f11a5980-b126-49f7-952e-f0ea8067a3c8" released by "_delete_snapshot" :: held 2.060s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" released by "delete_snapshot" :: held 2.072s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:38 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:38 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Created reservations ['97be1751-f731-467d-811f-72ae94e326cc', 'd7cd3dc1-c197-4dd4-86ae-08059d924057', '82f8ff61-2afd-4b2e-9d30-6c2579ab18a7', 'ced12196-8776-4002-be16-7e25f0545308'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Delete snapshot completed successfully. Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-f11a5980-b126-49f7-952e-f0ea8067a3c8-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Snapshots deleted, issuing volume delete {{(pid=83219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c515e-d858-462f-8e2e-25a305fa99f4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:38 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.492s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Deleted volume successfully. Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4ef93271-c562-4847-8b35-caf0519760ea tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c40fe21c-97d1-4eba-968b-4adf7cb5388d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:38 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 Apr 15 00:19:38 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:38 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945 Apr 15 00:19:39 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.538s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 Apr 15 00:19:39 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8 Apr 15 00:19:39 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3bc23b46-dbd8-4331-b044-facc13a34945" returned: 0 in 0.412s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-3bc23b46-dbd8-4331-b044-facc13a34945" released by "delete_volume" :: held 0.955s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Created reservations ['202ddd31-9b24-43fa-8c4c-4e3294b0036c', '0b49dfcb-f49f-42b8-9921-c8206cd1959e', 'fee4c5eb-0046-4ba1-b6eb-057eab9692eb', 'e38081b6-695a-47ce-abdc-1d612f218cc9'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:39 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-c20e0819-8955-4423-b16f-c504a2f6b8d1-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c20e0819-8955-4423-b16f-c504a2f6b8d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-quobyte-c20e0819-8955-4423-b16f-c504a2f6b8d1" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c20e0819-8955-4423-b16f-c504a2f6b8d1" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91638e3-687e-497a-b616-f50f296e85bf]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 Apr 15 00:19:39 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31" returned: 0 in 0.529s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31 Apr 15 00:19:39 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:39 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8" released by "delete_volume" :: held 0.947s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Created reservations ['7bfee045-086b-4f42-8eb0-b099c47a6116', 'e44824da-5445-4f24-825d-a7a382740fa2', 'bd59ecc7-4450-4759-9b9f-10910d114dfd', '9ebb55c2-463a-47dd-805c-75fdc272bec0'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:39 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:39 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:40 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Deleted volume successfully. Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-10df20ac-93ed-44dd-93d4-73286f503e71 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-3bc23b46-dbd8-4331-b044-facc13a34945-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1" returned: 0 in 0.528s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:40 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1 Apr 15 00:19:40 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:40 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2df96bba-a522-49d7-9db7-d3cb46efbd31" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-2df96bba-a522-49d7-9db7-d3cb46efbd31" released by "_delete_snapshot" :: held 2.067s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_snapshot" :: held 2.077s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Created reservations ['1443ee6b-a8d8-4702-85fb-86b89f0f6662', 'cc9f538b-9559-4a5a-85c4-b7092c47dd8c', '9b13b81d-889a-4e65-a31a-bffe476e9ec1', 'd6215ba4-62f6-4421-958b-cf458946bf9b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Delete snapshot completed successfully. Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-18b8f43f-8abe-4fb4-a24c-c9f4792b65f0 tempest-SnapshotsActionsTest-1620086659 None] Lock "cinder-2df96bba-a522-49d7-9db7-d3cb46efbd31-delete_snapshot" released by "delete_snapshot" :: held 2.174s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.454s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Deleted volume successfully. Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-aa5f04b3-35ef-43b7-a79f-197259bebc62 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-08a2ac04-e8fe-451f-a6c5-4ab1c4121cd8-delete_volume" released by "delete_volume" :: held 5.860s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c20e0819-8955-4423-b16f-c504a2f6b8d1" returned: 0 in 0.426s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-c20e0819-8955-4423-b16f-c504a2f6b8d1" released by "delete_volume" :: held 0.973s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Created reservations ['455a94c0-4d98-4a3d-84c3-39747d8577c8', 'd16d4d0c-b20e-4ca6-b285-0891a4a60185', 'a6cfbb2a-c7ec-4e68-b6ce-0e5523c2d449', '6bce87c5-d195-4868-a7f5-9b80fd0ac540'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:40 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:40 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "cinder-quobyte-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deca588-7daf-4512-9eac-dcf2a9416f08]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:40 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 Apr 15 00:19:40 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:41 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Deleted volume successfully. Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-43994cb2-fcb8-45b3-9028-e9198fbab1f3 tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-c20e0819-8955-4423-b16f-c504a2f6b8d1-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:41 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (d664a0e9-207f-4dac-a5bc-7173dd75a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c79851d-dbc7-4447-af75-29fd98f82533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c79851d-dbc7-4447-af75-29fd98f82533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-540192281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd22586-dcfa-4258-8238-068954827e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49a6fe057b7467b80fe7046c4d86c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:41Z,use_quota=True,user_id='8f235b47063947c1bf35c4a7212aaba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ae485d-6541-41e9-90aa-406ceaa7ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ae485d-6541-41e9-90aa-406ceaa7ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b42c882-0135-4088-b4ae-b178aa526aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b42c882-0135-4088-b4ae-b178aa526aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd22586-dcfa-4258-8238-068954827e38', 'volume_name': 'volume-7fd22586-dcfa-4258-8238-068954827e38', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177a14b9-aab3-4b20-88c5-79933fe8370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (177a14b9-aab3-4b20-88c5-79933fe8370d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12881d7-1710-45d2-893d-72a9b474738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Volume 7fd22586-dcfa-4258-8238-068954827e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd22586-dcfa-4258-8238-068954827e38', 'volume_size': 1} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-540192281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd22586-dcfa-4258-8238-068954827e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49a6fe057b7467b80fe7046c4d86c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:41Z,use_quota=True,user_id='8f235b47063947c1bf35c4a7212aaba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Creating volume 7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:41 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" returned: 0 in 0.598s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:41 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 1073741824 Apr 15 00:19:41 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:41 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58 Apr 15 00:19:41 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "cinder-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "cinder-quobyte-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Deleting offline snapshot 2c802fc8-4cc5-4d4e-a4e9-31b139ef280b of volume a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] snapshot_file for this snap is: volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4186282-8309-4885-99d1-2659f0f4c5a3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:41 devstack sudo[88974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:41 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:41 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" returned: 0 in 0.494s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-quobyte-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58" released by "delete_volume" :: held 1.117s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:41 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 1073741824" returned: 0 in 0.547s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Created reservations ['db2dd714-0d7a-494a-8d3e-7eceaebc232d', '34dbc771-603d-4de0-8225-31ee2dce2c99', '321aea73-5d9a-43a0-82a7-86d7393026f8', '547137fa-312a-4b23-b38a-a679b737c26e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:41 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:41 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:41 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:41 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:42 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.515s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abdc433-3f9d-476a-ab80-82c0f899add5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:42 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e Apr 15 00:19:42 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:42 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:42 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:42 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12881d7-1710-45d2-893d-72a9b474738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd22586-dcfa-4258-8238-068954827e38', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0309bc2-ea66-4d04-b923-f0619939be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:42 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Volume volume-7fd22586-dcfa-4258-8238-068954827e38 (7fd22586-dcfa-4258-8238-068954827e38): created successfully Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0309bc2-ea66-4d04-b923-f0619939be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (d664a0e9-207f-4dac-a5bc-7173dd75a933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a2208f6d-ecea-4025-99eb-0f1a9b12c208 tempest-VolumesDeleteCascade-425959162 None] Created volume successfully. Apr 15 00:19:42 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Deleted volume successfully. Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-533975f2-d0f6-46cf-83a7-40ace39e539d tempest-CreateVolumesFromImageTest-295909669 None] Lock "cinder-7cecafb6-71c8-4160-9ce4-e37ccd1f7b58-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:42 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e" returned: 0 in 0.485s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:42 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:42 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:42 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.425s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:43 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:43 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b Apr 15 00:19:43 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Creating offline snapshot 539219d3-d227-46b9-8152-34e54a3f0f3b of volume 7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e150128-b74f-43c2-8837-bf3d95fcf2d4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:43 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e.2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:43 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:43 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b" released by "_delete_snapshot" :: held 2.024s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_snapshot" :: held 2.036s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Created reservations ['91e19951-0569-4326-a4a7-22426546f13b', 'd9b296f0-08f6-4843-9f5a-e495a05c784f', 'a4d5704a-4abe-4dd2-9e7c-aacff93f2132', '2a948313-e3e1-4725-9b26-f7801b0a204b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:43 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Delete snapshot completed successfully. Apr 15 00:19:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b9d13c2-9653-40e3-85a0-6db8b44ebb77 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-2c802fc8-4cc5-4d4e-a4e9-31b139ef280b-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:44 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.541s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:44 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b 1G Apr 15 00:19:44 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:44 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b 1G" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd22586-dcfa-4258-8238-068954827e38 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:44 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd22586-dcfa-4258-8238-068954827e38 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:44 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "cinder-a7d881fd-1e68-4da1-b3fd-466fb68b903e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-a7d881fd-1e68-4da1-b3fd-466fb68b903e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020434a-9aac-4f60-96f4-c8ae86d7a028]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:44 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e Apr 15 00:19:44 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:44 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd22586-dcfa-4258-8238-068954827e38 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.413s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:44 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b is being set with open permissions: ugo+rw Apr 15 00:19:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:44 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:44 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:45 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:45 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e Apr 15 00:19:45 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:45 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.413s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:45 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info Apr 15 00:19:45 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:45 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a7d881fd-1e68-4da1-b3fd-466fb68b903e" returned: 0 in 0.404s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-quobyte-a7d881fd-1e68-4da1-b3fd-466fb68b903e" released by "delete_volume" :: held 0.898s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Created reservations ['3eae37b3-763e-4f58-9935-9a1bdf0de98c', '5e68745b-9ed1-4357-8080-230d50e8f3a2', '5177fc4e-05c3-48e8-8527-4061188caed2', 'c698319b-d18a-4bd6-bc30-636bef2cfea9'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:45 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info" returned: 0 in 0.428s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:45 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info is being set with open permissions: ugo+rw Apr 15 00:19:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:45 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:45 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:45 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info Apr 15 00:19:45 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:46 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.437s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Deleted volume successfully. Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-717e9106-9ed7-4a1a-92f8-a3c5d97962b5 tempest-SnapshotsActionsTest-255651060 None] Lock "cinder-a7d881fd-1e68-4da1-b3fd-466fb68b903e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:46 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.info" returned: 0 in 0.457s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6a308d70-fb8c-4231-bfb0-ea5565022b68 tempest-VolumesDeleteCascade-425959162 None] Create snapshot completed successfully Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (e6b0bd6c-0c01-4800-a0dd-62c07ad887de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb32f33-f29a-44d7-ab8c-86b0897b4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb32f33-f29a-44d7-ab8c-86b0897b4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-65683045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59f696d-19d7-4102-a773-71fedc3f247f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49a6fe057b7467b80fe7046c4d86c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=539219d3-d227-46b9-8152-34e54a3f0f3b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:47Z,use_quota=True,user_id='8f235b47063947c1bf35c4a7212aaba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6914c9-b814-4f78-93de-35e17143eb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6914c9-b814-4f78-93de-35e17143eb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1defdcb7-41e8-49d3-89b4-5316f535bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1defdcb7-41e8-49d3-89b4-5316f535bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b59f696d-19d7-4102-a773-71fedc3f247f', 'volume_name': 'volume-b59f696d-19d7-4102-a773-71fedc3f247f', 'volume_size': 1, 'snapshot_id': '539219d3-d227-46b9-8152-34e54a3f0f3b'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039d3d14-2c66-41ee-b57f-d35c3d994af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039d3d14-2c66-41ee-b57f-d35c3d994af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af06af-7015-4a07-8d2e-47e0e5cbbb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:46 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Volume b59f696d-19d7-4102-a773-71fedc3f247f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b59f696d-19d7-4102-a773-71fedc3f247f', 'volume_size': 1, 'snapshot_id': '539219d3-d227-46b9-8152-34e54a3f0f3b'} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b-b59f696d-19d7-4102-a773-71fedc3f247f" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b-b59f696d-19d7-4102-a773-71fedc3f247f" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Creating volume b59f696d-19d7-4102-a773-71fedc3f247f from snapshot 539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] snapshot: 539219d3-d227-46b9-8152-34e54a3f0f3b, volume: b59f696d-19d7-4102-a773-71fedc3f247f, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[07db2002-9244-40d8-92ff-5715af3f114d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:47 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:47 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:47 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.549s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd22586-dcfa-4258-8238-068954827e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0954e07-f0fe-417c-90fd-ef7eebc10eb3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:47 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:47 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:48 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.518s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:48 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:19:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:48 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f Apr 15 00:19:48 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:50 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f" returned: 0 in 2.146s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89904bf-f97b-4445-a144-764eda96b053]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:50 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:50 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:50 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.662s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:19:50 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Converted 1024.00 MB image at 476.84 MB/s Apr 15 00:19:50 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f is being set with open permissions: ugo+rw Apr 15 00:19:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:50 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f Apr 15 00:19:50 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:51 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f" returned: 0 in 0.462s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" released by "_copy_volume_from_snapshot" :: held 4.390s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b-b59f696d-19d7-4102-a773-71fedc3f247f" released by "_create_volume_from_snapshot" :: held 4.406s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.414s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af06af-7015-4a07-8d2e-47e0e5cbbb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59f696d-19d7-4102-a773-71fedc3f247f', 'volume_size': 1, 'snapshot_id': '539219d3-d227-46b9-8152-34e54a3f0f3b'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e0e997-e0f2-4c87-8d34-ed2ba061b939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:51 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Volume volume-b59f696d-19d7-4102-a773-71fedc3f247f (b59f696d-19d7-4102-a773-71fedc3f247f): created successfully Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e0e997-e0f2-4c87-8d34-ed2ba061b939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Flow 'volume_create_manager' (e6b0bd6c-0c01-4800-a0dd-62c07ad887de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-485698fd-3927-42de-a00e-a5a5997b1f2f tempest-VolumesDeleteCascade-425959162 None] Created volume successfully. Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-7fd22586-dcfa-4258-8238-068954827e38-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-7fd22586-dcfa-4258-8238-068954827e38-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Performing cascade delete. {{(pid=83219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-539219d3-d227-46b9-8152-34e54a3f0f3b-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-539219d3-d227-46b9-8152-34e54a3f0f3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Deleting offline snapshot 539219d3-d227-46b9-8152-34e54a3f0f3b of volume 7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] snapshot_file for this snap is: volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[613a0573-c19e-4ee3-a32a-c60d4c9414a4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:52 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:52 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:52 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd22586-dcfa-4258-8238-068954827e38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fb78ec-2ae5-42db-bcf6-57e0797d6b34]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:52 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:52 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Flow 'volume_create_manager' (b5901b7b-901f-47b8-a1cf-242772cc37ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96fe6ba-bde1-4dd4-a96b-d3a2bd7398ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96fe6ba-bde1-4dd4-a96b-d3a2bd7398ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-666702857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c4be82-a6f3-4589-b9c2-490db8df6065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6043efc0a6b44b29d55ca3824c5bbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:53Z,use_quota=True,user_id='15db0ee79ed741f6ae3ab1c155c93762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97f77c4-85e6-443f-8d50-56f304ac3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97f77c4-85e6-443f-8d50-56f304ac3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aab4f63-9e80-467a-90a1-4ad90aeef28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aab4f63-9e80-467a-90a1-4ad90aeef28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c4be82-a6f3-4589-b9c2-490db8df6065', 'volume_name': 'volume-b5c4be82-a6f3-4589-b9c2-490db8df6065', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa46680-3f81-4b1a-9505-f66f1042474e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa46680-3f81-4b1a-9505-f66f1042474e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d584c4fa-92a2-413b-bc64-27ee58efd695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume b5c4be82-a6f3-4589-b9c2-490db8df6065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c4be82-a6f3-4589-b9c2-490db8df6065', 'volume_size': 1} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-666702857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c4be82-a6f3-4589-b9c2-490db8df6065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6043efc0a6b44b29d55ca3824c5bbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:53Z,use_quota=True,user_id='15db0ee79ed741f6ae3ab1c155c93762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Creating volume b5c4be82-a6f3-4589-b9c2-490db8df6065 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:53 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:53 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 1073741824 Apr 15 00:19:53 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:53 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:53 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:53 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:53 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 1073741824" returned: 0 in 0.494s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:53 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:53 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b Apr 15 00:19:53 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:53 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 Apr 15 00:19:53 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:54 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38.539219d3-d227-46b9-8152-34e54a3f0f3b" returned: 0 in 0.419s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-539219d3-d227-46b9-8152-34e54a3f0f3b" released by "_delete_snapshot" :: held 1.908s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" released by "delete_snapshot" :: held 1.921s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:54 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d584c4fa-92a2-413b-bc64-27ee58efd695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c4be82-a6f3-4589-b9c2-490db8df6065', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963d197f-7f25-4990-b28d-d15c4714fc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:54 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 (b5c4be82-a6f3-4589-b9c2-490db8df6065): created successfully Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963d197f-7f25-4990-b28d-d15c4714fc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Flow 'volume_create_manager' (b5901b7b-901f-47b8-a1cf-242772cc37ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:54 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ded2e3ce-a145-4765-a159-c51b88a8cc98 tempest-VolumeQuotasAdminTestJSON-527797004 None] Created volume successfully. Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Created reservations ['08580e3c-2994-4e2c-beef-68bde2cc5c6f', '59b082bd-7aaa-466d-8256-2acc722a2419', '2315cd81-9eec-473b-b875-fbf8c09a5ed5', '3ba83b8a-e56d-48f8-88ff-9ca6ad456436'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:54 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Delete snapshot completed successfully. Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-539219d3-d227-46b9-8152-34e54a3f0f3b-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Snapshots deleted, issuing volume delete {{(pid=83219) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc599f0-65cd-4413-b730-300d2cda8224]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:54 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:54 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:54 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:54 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38 Apr 15 00:19:54 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:55 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7fd22586-dcfa-4258-8238-068954827e38" returned: 0 in 0.404s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-7fd22586-dcfa-4258-8238-068954827e38" released by "delete_volume" :: held 0.906s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Created reservations ['de461650-625a-4e82-a0db-ce35fba02bca', '87e7aa64-0a7d-4329-aedf-a7247c406809', 'f1e2c9ca-f2ec-4102-8920-440c79f4a844', 'd2b6af1a-6a00-4f4a-8864-e0fdc1aa4d74'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:55 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:55 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "cinder-b5c4be82-a6f3-4589-b9c2-490db8df6065-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "cinder-b5c4be82-a6f3-4589-b9c2-490db8df6065-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "cinder-quobyte-b5c4be82-a6f3-4589-b9c2-490db8df6065" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "cinder-quobyte-b5c4be82-a6f3-4589-b9c2-490db8df6065" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d83bf2-d3b3-4667-9192-74537522c496]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:55 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 Apr 15 00:19:55 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-b59f696d-19d7-4102-a773-71fedc3f247f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-b59f696d-19d7-4102-a773-71fedc3f247f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92ddf58-1d58-4d39-9450-04e7050b0f7d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:55 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f Apr 15 00:19:55 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:55 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.441s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:55 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Deleted volume successfully. Apr 15 00:19:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4b2ba3dc-d80d-4004-be70-83f1ca36787c tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-7fd22586-dcfa-4258-8238-068954827e38-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:56 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065" returned: 0 in 0.520s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:56 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065 Apr 15 00:19:56 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:56 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f" returned: 0 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:56 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f Apr 15 00:19:56 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:56 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b5c4be82-a6f3-4589-b9c2-490db8df6065" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "cinder-quobyte-b5c4be82-a6f3-4589-b9c2-490db8df6065" released by "delete_volume" :: held 0.942s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Created reservations ['3091a0b9-7b04-4356-8dd5-b336eb3a7a78', 'e498415a-c9b1-42af-82c6-3622d817fc11', '07c2cc30-96dd-40b2-9419-13fae4e4f585', 'c582bb9c-3a37-48d4-b6df-54fe9e24ee84'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:56 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:56 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:56 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b59f696d-19d7-4102-a773-71fedc3f247f" returned: 0 in 0.420s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-quobyte-b59f696d-19d7-4102-a773-71fedc3f247f" released by "delete_volume" :: held 0.931s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Created reservations ['84b709ab-ef20-4b90-af50-e8e52e12dc92', 'c8fe0549-15e1-4fd2-a5a3-76251744939a', 'd661e2dd-6099-4191-b3cc-38a6a7850a77', 'd6766675-bd24-416c-b3be-2273d27bcbce'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:56 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:19:56 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Flow 'volume_create_manager' (7e60d881-01e3-4aa9-bd21-a02af2bb13bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c71125-0f33-450a-8e76-bfd1788570a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c71125-0f33-450a-8e76-bfd1788570a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1837591708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c586964-d2d9-4a31-bf17-438ca692b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6043efc0a6b44b29d55ca3824c5bbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:57Z,use_quota=True,user_id='15db0ee79ed741f6ae3ab1c155c93762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4f315-5183-4c63-8d33-f998e0a3381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f4f315-5183-4c63-8d33-f998e0a3381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a8859f-9e8c-46d7-b8c5-d84af1cf767b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a8859f-9e8c-46d7-b8c5-d84af1cf767b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c586964-d2d9-4a31-bf17-438ca692b290', 'volume_name': 'volume-6c586964-d2d9-4a31-bf17-438ca692b290', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a4c418-1eb2-451a-8994-5774aeafbeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a4c418-1eb2-451a-8994-5774aeafbeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e413d-9733-4b79-8185-29389f024dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:56 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume 6c586964-d2d9-4a31-bf17-438ca692b290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c586964-d2d9-4a31-bf17-438ca692b290', 'volume_size': 1} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1837591708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c586964-d2d9-4a31-bf17-438ca692b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6043efc0a6b44b29d55ca3824c5bbb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:57Z,use_quota=True,user_id='15db0ee79ed741f6ae3ab1c155c93762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Creating volume 6c586964-d2d9-4a31-bf17-438ca692b290 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:56 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:56 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 1073741824 Apr 15 00:19:56 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:56 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:56 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Deleted volume successfully. Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-075ecac0-6875-418a-a518-26c4781eb3de tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "cinder-b5c4be82-a6f3-4589-b9c2-490db8df6065-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:57 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:19:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Deleted volume successfully. Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b4b31622-0472-426c-ac30-79d445d82014 tempest-VolumesDeleteCascade-425959162 None] Lock "cinder-b59f696d-19d7-4102-a773-71fedc3f247f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:19:57 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 1073741824" returned: 0 in 0.568s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:57 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 Apr 15 00:19:57 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:57 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998e413d-9733-4b79-8185-29389f024dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c586964-d2d9-4a31-bf17-438ca692b290', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1198a3e-ac10-4a19-9029-07a964504dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:57 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Volume volume-6c586964-d2d9-4a31-bf17-438ca692b290 (6c586964-d2d9-4a31-bf17-438ca692b290): created successfully Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1198a3e-ac10-4a19-9029-07a964504dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Flow 'volume_create_manager' (7e60d881-01e3-4aa9-bd21-a02af2bb13bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5c579bf9-4041-4470-aee6-647d262f9190 tempest-VolumeQuotasAdminTestJSON-527797004 None] Created volume successfully. Apr 15 00:19:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7bb5d2ad-268b-453e-9bd3-ebdeaff77ed3 tempest-VolumeQuotasAdminTestJSON-446958481 None] Transfer volume completed successfully. Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Flow 'volume_create_manager' (6792f423-36d8-4ce8-8f7d-743ee0ec339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2fd970-86ba-4996-bbe9-392276f1dffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2fd970-86ba-4996-bbe9-392276f1dffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1791498958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d268379d-77d9-4301-b13e-82e7a1de65bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f2b3044f9f410eb2d2c11dcd0c03b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:59Z,use_quota=True,user_id='41c0a0ad526a420ca9bc16dc87047bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c9d13e-f007-4e6a-acf1-5073cdd85407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c9d13e-f007-4e6a-acf1-5073cdd85407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bed92db-2966-4fb2-b9c4-a3e3c42764f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bed92db-2966-4fb2-b9c4-a3e3c42764f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd268379d-77d9-4301-b13e-82e7a1de65bd', 'volume_name': 'volume-d268379d-77d9-4301-b13e-82e7a1de65bd', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f36fd77-de31-418d-84d6-516e537b9fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f36fd77-de31-418d-84d6-516e537b9fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263345c7-2b16-49dd-8896-1ba6b5f7a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:19:59 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Volume d268379d-77d9-4301-b13e-82e7a1de65bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d268379d-77d9-4301-b13e-82e7a1de65bd', 'volume_size': 1} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1791498958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d268379d-77d9-4301-b13e-82e7a1de65bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f2b3044f9f410eb2d2c11dcd0c03b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:19:59Z,use_quota=True,user_id='41c0a0ad526a420ca9bc16dc87047bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Creating volume d268379d-77d9-4301-b13e-82e7a1de65bd {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:19:59 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:59 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd 1073741824 Apr 15 00:19:59 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:19:59 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd 1073741824" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:19:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:19:59 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd Apr 15 00:19:59 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Acquiring lock "cinder-6c586964-d2d9-4a31-bf17-438ca692b290-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "cinder-6c586964-d2d9-4a31-bf17-438ca692b290-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Acquiring lock "cinder-quobyte-6c586964-d2d9-4a31-bf17-438ca692b290" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "cinder-quobyte-6c586964-d2d9-4a31-bf17-438ca692b290" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5031a807-7521-403a-9ca5-dfeca93c9c1c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:00 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 Apr 15 00:20:00 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:00 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd" returned: 0 in 0.440s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263345c7-2b16-49dd-8896-1ba6b5f7a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d268379d-77d9-4301-b13e-82e7a1de65bd', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1417888-80af-4e76-b8b1-397de36c8466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:00 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Volume volume-d268379d-77d9-4301-b13e-82e7a1de65bd (d268379d-77d9-4301-b13e-82e7a1de65bd): created successfully Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1417888-80af-4e76-b8b1-397de36c8466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Flow 'volume_create_manager' (6792f423-36d8-4ce8-8f7d-743ee0ec339d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:00 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-59797071-6641-42be-a365-46959f8cc784 tempest-VolumesTransfersV355Test-32511032 None] Created volume successfully. Apr 15 00:20:00 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:00 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290 Apr 15 00:20:00 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:01 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6c586964-d2d9-4a31-bf17-438ca692b290" returned: 0 in 0.404s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "cinder-quobyte-6c586964-d2d9-4a31-bf17-438ca692b290" released by "delete_volume" :: held 0.905s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Created reservations ['7bc9a205-a2a7-414c-a8ec-26b865cdb2f0', '726af17e-6fed-4e08-aeec-4b8aa72205b3', 'bc49f2d8-0ead-451e-b47f-fd43857ac942', '5d724383-d742-46de-9ac7-9e7f628560d8'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:01 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:01 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:01 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Deleted volume successfully. Apr 15 00:20:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-353f37f3-bdb7-44b2-ab2b-62813d59b531 tempest-VolumeQuotasAdminTestJSON-185614510 None] Lock "cinder-6c586964-d2d9-4a31-bf17-438ca692b290-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f79e0af8-b770-41ae-b02e-35f91a2d3add tempest-VolumesTransfersV355Test-1231742716 None] Transfer volume completed successfully. Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "cinder-d268379d-77d9-4301-b13e-82e7a1de65bd-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-d268379d-77d9-4301-b13e-82e7a1de65bd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=266,cinder:SELECT=192,cinder:INSERT=60,cinder:DELETE=18 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "cinder-quobyte-d268379d-77d9-4301-b13e-82e7a1de65bd" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-quobyte-d268379d-77d9-4301-b13e-82e7a1de65bd" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc291d-1768-49c3-8a4a-ab72b6fce123]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:02 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd Apr 15 00:20:02 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:03 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd" returned: 0 in 0.535s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:03 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd Apr 15 00:20:03 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:03 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d268379d-77d9-4301-b13e-82e7a1de65bd" returned: 0 in 0.497s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-quobyte-d268379d-77d9-4301-b13e-82e7a1de65bd" released by "delete_volume" :: held 1.059s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:03 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Created reservations ['8cc0e3fe-9230-4eb8-9c2a-71d77477561d', '24b17ba1-94bb-40a0-836a-6b469644389e', 'c2721fc5-d139-47cd-b029-e188be55688b', '7eb62cea-ee2b-461c-9242-d27e4f2adbda'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:04 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:04 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:04 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:04 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Deleted volume successfully. Apr 15 00:20:04 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-12c1420c-e377-4766-af6a-dc3387fb03ee tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-d268379d-77d9-4301-b13e-82e7a1de65bd-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Flow 'volume_create_manager' (1cf62151-8c11-4892-b3d3-ebbd7cee9e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc093f7f-a40e-421c-8700-b9c3d0e4850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc093f7f-a40e-421c-8700-b9c3d0e4850c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1810402381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd3583-06c7-4b6a-ab0b-58f65addda88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f2b3044f9f410eb2d2c11dcd0c03b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:05Z,use_quota=True,user_id='41c0a0ad526a420ca9bc16dc87047bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472a24ef-9747-4d40-879a-667ffbb16163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472a24ef-9747-4d40-879a-667ffbb16163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5549eb-a504-4324-bd1d-ab6a3b5a245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5549eb-a504-4324-bd1d-ab6a3b5a245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cd3583-06c7-4b6a-ab0b-58f65addda88', 'volume_name': 'volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fa0712-9634-44d5-ac9c-39c101013879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03fa0712-9634-44d5-ac9c-39c101013879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bca3fc-b1cb-488e-920d-4b6e9a05197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Volume d4cd3583-06c7-4b6a-ab0b-58f65addda88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88', 'volume_size': 1} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1810402381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cd3583-06c7-4b6a-ab0b-58f65addda88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f2b3044f9f410eb2d2c11dcd0c03b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:05Z,use_quota=True,user_id='41c0a0ad526a420ca9bc16dc87047bd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Creating volume d4cd3583-06c7-4b6a-ab0b-58f65addda88 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:05 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:05 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 1073741824 Apr 15 00:20:05 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Flow 'volume_create_manager' (a385dc8c-50aa-4a4b-9cb6-c5d09acad9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68fc400-d0ef-4e19-b129-390113d3e7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68fc400-d0ef-4e19-b129-390113d3e7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-645912856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d646ce2f-bd36-4f5c-9b58-2f32bbb7650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ee83aa287543ea928caf9abbf05b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:05Z,use_quota=True,user_id='8b2ff8229e4343a8abbdd29588c5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d30af3e-22f9-4c83-95d5-e436a6936aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d30af3e-22f9-4c83-95d5-e436a6936aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e99382b-5e30-45e6-810b-918372c63798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e99382b-5e30-45e6-810b-918372c63798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd646ce2f-bd36-4f5c-9b58-2f32bbb7650e', 'volume_name': 'volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfc433d-d6cb-4e4f-b40a-528427c80c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfc433d-d6cb-4e4f-b40a-528427c80c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369d9031-3e90-449d-bf8e-e35c97aa04e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:05 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Volume d646ce2f-bd36-4f5c-9b58-2f32bbb7650e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e', 'volume_size': 1} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:05 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 1073741824" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:05 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 Apr 15 00:20:05 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:06 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.806s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-645912856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d646ce2f-bd36-4f5c-9b58-2f32bbb7650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44ee83aa287543ea928caf9abbf05b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:05Z,use_quota=True,user_id='8b2ff8229e4343a8abbdd29588c5aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Creating volume d646ce2f-bd36-4f5c-9b58-2f32bbb7650e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:06 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bca3fc-b1cb-488e-920d-4b6e9a05197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc25b5d-aff1-4b66-b5ad-c0bd162bd30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:06 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e 1073741824 Apr 15 00:20:06 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:06 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Volume volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 (d4cd3583-06c7-4b6a-ab0b-58f65addda88): created successfully Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc25b5d-aff1-4b66-b5ad-c0bd162bd30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Flow 'volume_create_manager' (1cf62151-8c11-4892-b3d3-ebbd7cee9e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:06 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-607f095a-c6e4-422f-b9b3-b3097ea41940 tempest-VolumesTransfersV355Test-32511032 None] Created volume successfully. Apr 15 00:20:06 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e 1073741824" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:06 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e Apr 15 00:20:06 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:07 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" returned: 0 in 0.403s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369d9031-3e90-449d-bf8e-e35c97aa04e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc69b424-edb1-4716-bb0c-e1e89985d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Volume volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e (d646ce2f-bd36-4f5c-9b58-2f32bbb7650e): created successfully Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc69b424-edb1-4716-bb0c-e1e89985d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Flow 'volume_create_manager' (a385dc8c-50aa-4a4b-9cb6-c5d09acad9aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-18c0d72f-55c3-4d2c-8d02-1e34fb7d61e3 tempest-VolumesServicesTestJSON-348576998 None] Created volume successfully. Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Acquiring lock "cinder-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "cinder-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Acquiring lock "cinder-quobyte-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "cinder-quobyte-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8759d2-7fd4-4adc-bbfb-76a22dfa7f55]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "cinder-d4cd3583-06c7-4b6a-ab0b-58f65addda88-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-d4cd3583-06c7-4b6a-ab0b-58f65addda88-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "cinder-quobyte-d4cd3583-06c7-4b6a-ab0b-58f65addda88" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:07 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e Apr 15 00:20:07 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-quobyte-d4cd3583-06c7-4b6a-ab0b-58f65addda88" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0b29a-bcd5-44e7-ae24-e0f665ae0415]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:07 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 Apr 15 00:20:07 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:08 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:08 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e Apr 15 00:20:08 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:08 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:08 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88 Apr 15 00:20:08 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:08 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "cinder-quobyte-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e" released by "delete_volume" :: held 0.939s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Created reservations ['87c1f735-d0ef-443b-9fbe-49dc2bef80b1', '572e0618-d71e-4fa6-a991-e438060c86bd', '10884386-a9f8-4205-b011-f9175f7276d5', '1ecf0131-b39f-40ef-9b3c-b65f45016606'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:08 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d4cd3583-06c7-4b6a-ab0b-58f65addda88" returned: 0 in 0.423s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-quobyte-d4cd3583-06c7-4b6a-ab0b-58f65addda88" released by "delete_volume" :: held 0.925s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:08 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:08 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Created reservations ['98233544-786e-41d9-8d2a-9f072d5d487b', 'b82943ba-ca59-478f-a4ba-c31b33c9cdd5', '09cd8bbf-d7da-4eb3-9aac-4ba0225c63b1', '9ad4122c-0efa-4618-ab46-77a75fe3858f'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:08 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:08 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:09 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.497s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:09 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Deleted volume successfully. Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-34b42297-b5ce-486f-a3e5-c73e43837ee2 tempest-VolumesServicesTestJSON-348576998 None] Lock "cinder-d646ce2f-bd36-4f5c-9b58-2f32bbb7650e-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:09 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:09 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Deleted volume successfully. Apr 15 00:20:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-77729224-4ae9-478f-ac6a-90a728345f0c tempest-VolumesTransfersV355Test-102613943 None] Lock "cinder-d4cd3583-06c7-4b6a-ab0b-58f65addda88-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Flow 'volume_create_manager' (b244f9cc-2118-4ac5-95c6-760636342411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e896b4ab-72b9-4468-8ac1-630e757fa8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e896b4ab-72b9-4468-8ac1-630e757fa8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1915402912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646cedff-10ed-44e8-8a94-cad9a6ad8e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6b0f8bdcc41e0a6a5d20a2ab70bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:12Z,use_quota=True,user_id='83f6a2f4e1d04cb5a2c3c4a3325da900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bf2dae-5915-42fd-90ae-ba9bf604d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bf2dae-5915-42fd-90ae-ba9bf604d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb88dc08-dbc7-454f-8bad-564f14bd83c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb88dc08-dbc7-454f-8bad-564f14bd83c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'volume_name': 'volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e752e0f9-e0da-4bac-b086-cfa88b92cffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e752e0f9-e0da-4bac-b086-cfa88b92cffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c124dac-599e-4559-bf92-77ca4e43c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Volume 646cedff-10ed-44e8-8a94-cad9a6ad8e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'volume_size': 1} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1915402912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646cedff-10ed-44e8-8a94-cad9a6ad8e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6b0f8bdcc41e0a6a5d20a2ab70bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:12Z,use_quota=True,user_id='83f6a2f4e1d04cb5a2c3c4a3325da900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Creating volume 646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:12 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:12 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a 1073741824 Apr 15 00:20:12 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Flow 'volume_create_manager' (9922efa5-1889-4c8e-a483-b2c98acd6416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d29f539-58c9-4368-a99e-8448500b8c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d29f539-58c9-4368-a99e-8448500b8c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-274114401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81447ccd-cd0f-47b2-93da-26ae55468140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc4a7ac926423bb1f772130a6fbe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:12Z,use_quota=True,user_id='16ce2c61e1344c44af61bcdaf6e53d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e6416ec-f80c-433a-b6ef-6f0a89dda1d3),volume_type_id=8e6416ec-f80c-433a-b6ef-6f0a89dda1d3)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebaceba-bb38-4e0a-8e0d-50ea1572fe1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebaceba-bb38-4e0a-8e0d-50ea1572fe1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf7b4a3-9533-4ed1-89a0-8151618cecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf7b4a3-9533-4ed1-89a0-8151618cecd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81447ccd-cd0f-47b2-93da-26ae55468140', 'volume_name': 'volume-81447ccd-cd0f-47b2-93da-26ae55468140', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12f77c3-0f01-4658-8c6c-cdf5563d159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12f77c3-0f01-4658-8c6c-cdf5563d159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6456c07a-dc4f-4df2-bb83-11d86db3c6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Volume 81447ccd-cd0f-47b2-93da-26ae55468140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81447ccd-cd0f-47b2-93da-26ae55468140', 'volume_size': 1} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:12 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a 1073741824" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:12 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:12 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:13 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-274114401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81447ccd-cd0f-47b2-93da-26ae55468140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0dc4a7ac926423bb1f772130a6fbe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:12Z,use_quota=True,user_id='16ce2c61e1344c44af61bcdaf6e53d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e6416ec-f80c-433a-b6ef-6f0a89dda1d3),volume_type_id=8e6416ec-f80c-433a-b6ef-6f0a89dda1d3)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Creating volume 81447ccd-cd0f-47b2-93da-26ae55468140 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:13 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c124dac-599e-4559-bf92-77ca4e43c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe22bb3-f250-40cc-8777-04c6f1089d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:13 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 1073741824 Apr 15 00:20:13 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Volume volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a (646cedff-10ed-44e8-8a94-cad9a6ad8e0a): created successfully Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe22bb3-f250-40cc-8777-04c6f1089d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Flow 'volume_create_manager' (b244f9cc-2118-4ac5-95c6-760636342411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4a5c6a95-ecbe-44d8-8cd0-87afffe3af1f tempest-VolumesCloneTest-1402464837 None] Created volume successfully. Apr 15 00:20:13 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 1073741824" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:13 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 Apr 15 00:20:13 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:14 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6456c07a-dc4f-4df2-bb83-11d86db3c6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81447ccd-cd0f-47b2-93da-26ae55468140', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4753c-1780-4dbc-8d7b-6ef87e3a619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Volume volume-81447ccd-cd0f-47b2-93da-26ae55468140 (81447ccd-cd0f-47b2-93da-26ae55468140): created successfully Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f4753c-1780-4dbc-8d7b-6ef87e3a619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Flow 'volume_create_manager' (9922efa5-1889-4c8e-a483-b2c98acd6416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8b7104ee-cd6f-4d40-a80b-50f192a8e1f9 tempest-VolumeTypesAccessTest-128578638 None] Created volume successfully. Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Acquiring lock "cinder-81447ccd-cd0f-47b2-93da-26ae55468140-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "cinder-81447ccd-cd0f-47b2-93da-26ae55468140-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Acquiring lock "cinder-quobyte-81447ccd-cd0f-47b2-93da-26ae55468140" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "cinder-quobyte-81447ccd-cd0f-47b2-93da-26ae55468140" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Flow 'volume_create_manager' (ebc4ed96-d97f-48c4-bcb3-0ee948ba9595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0e0c94-4766-4b98-b86a-f8c4a6b595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc803ecd-72e9-48c4-9b9f-2d06f325ad10]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0e0c94-4766-4b98-b86a-f8c4a6b595f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2077944321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65b007c-247d-450c-9998-d53dca3f4ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba6b0f8bdcc41e0a6a5d20a2ab70bfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=646cedff-10ed-44e8-8a94-cad9a6ad8e0a,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:15Z,use_quota=True,user_id='83f6a2f4e1d04cb5a2c3c4a3325da900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd566810-de95-49b0-8c73-b09513591381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd566810-de95-49b0-8c73-b09513591381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a20f6c-fb34-4a49-9e49-9f339b98af87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a20f6c-fb34-4a49-9e49-9f339b98af87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd65b007c-247d-450c-9998-d53dca3f4ad9', 'volume_name': 'volume-d65b007c-247d-450c-9998-d53dca3f4ad9', 'volume_size': 2, 'source_volid': '646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6812e27c-ae46-42de-9ade-faa114f411d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6812e27c-ae46-42de-9ade-faa114f411d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92228d0-4480-447b-bbf7-25eaede92469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:14 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Volume d65b007c-247d-450c-9998-d53dca3f4ad9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d65b007c-247d-450c-9998-d53dca3f4ad9', 'volume_size': 2, 'source_volid': '646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'source_volstatus': 'available'} Apr 15 00:20:14 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 Apr 15 00:20:14 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:14 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Cloning volume 646cedff-10ed-44e8-8a94-cad9a6ad8e0a to volume d65b007c-247d-450c-9998-d53dca3f4ad9 Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Creating offline snapshot f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 of volume 646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede226e-e521-49ed-8fd3-f0c2cb3e2892]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:14 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:14 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:15 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:15 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140 Apr 15 00:20:15 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:15 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:15 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 1G Apr 15 00:20:15 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:15 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-81447ccd-cd0f-47b2-93da-26ae55468140" returned: 0 in 0.409s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "cinder-quobyte-81447ccd-cd0f-47b2-93da-26ae55468140" released by "delete_volume" :: held 0.923s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:15 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-370091334 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-370091334, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:20:15 devstack cinder-volume[83219]: WARNING cinder.quota [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-370091334 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-370091334, it is now deprecated. Please use the default quota class for default quota. Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Created reservations ['a7f40a8a-7551-4a3d-93c1-5583404d156e', 'a73bda1a-da30-41e2-8b93-e1c24fe7c486', '98d94ec3-20d8-4cd9-87c4-caaa9d8a8074', '0b17d325-4acb-4dbc-9c9c-42ce574659f5'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:15 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:15 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:15 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 1G" returned: 0 in 0.550s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:15 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:15 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:16 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Deleted volume successfully. Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b1dac517-4b66-484d-b055-fab8206ce47f tempest-VolumeTypesAccessTest-128578638 None] Lock "cinder-81447ccd-cd0f-47b2-93da-26ae55468140-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:16 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:16 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 is being set with open permissions: ugo+rw Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:16 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:16 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:16 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:16 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info Apr 15 00:20:16 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:17 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info" returned: 0 in 0.457s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:17 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info is being set with open permissions: ugo+rw Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:17 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info Apr 15 00:20:17 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:17 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.info" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] snapshot: f6abfa4b-c3e1-415b-a5af-c8dd84b40e42, volume: d65b007c-247d-450c-9998-d53dca3f4ad9, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04e0190-fb13-41d4-b783-716e0b50331b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:17 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:17 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:18 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.567s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8783baaa-4ba9-4d0f-a349-627b817567ed]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:18 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:18 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:18 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.570s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:20:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:18 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 Apr 15 00:20:18 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:21 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9" returned: 0 in 2.166s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5148f28-1e68-4642-acaa-d97bce0d93c5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:21 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:21 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:21 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.673s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:20:21 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Converted 1024.00 MB image at 472.42 MB/s Apr 15 00:20:21 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 is being set with open permissions: ugo+rw Apr 15 00:20:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:21 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 Apr 15 00:20:21 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:22 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" released by "_copy_volume_from_snapshot" :: held 4.523s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-quobyte-f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Deleting offline snapshot f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 of volume 646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] snapshot_file for this snap is: volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e563e8e-63f1-4fc2-9024-69bee8d628fb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:22 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:22 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:22 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc83639-86e7-4fcc-83d6-23a498801e94]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:22 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:22 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:23 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.524s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:23 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:23 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (fa515c0c-794b-4cd9-b1cf-d22c3f7b88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353fccd6-1ab3-4ed0-9048-ca70420b4676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:23 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.567s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353fccd6-1ab3-4ed0-9048-ca70420b4676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2081466884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a37fa4-209c-4098-ac8b-6291d459940f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:24Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:23 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42 Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698f4f86-2220-44a4-826c-bd0e70d38d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:23 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698f4f86-2220-44a4-826c-bd0e70d38d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a88204f-fa2a-490a-857a-3910a06630b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a88204f-fa2a-490a-857a-3910a06630b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a37fa4-209c-4098-ac8b-6291d459940f', 'volume_name': 'volume-08a37fa4-209c-4098-ac8b-6291d459940f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182c7b8e-4a46-4fa3-9594-fe19dddea914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182c7b8e-4a46-4fa3-9594-fe19dddea914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e899b0ac-6b68-4b5f-b42d-d508a5373b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Volume 08a37fa4-209c-4098-ac8b-6291d459940f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a37fa4-209c-4098-ac8b-6291d459940f', 'volume_size': 1} Apr 15 00:20:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:24 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a.f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" returned: 0 in 0.434s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-f6abfa4b-c3e1-415b-a5af-c8dd84b40e42" released by "_delete_snapshot" :: held 2.066s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.618s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2081466884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a37fa4-209c-4098-ac8b-6291d459940f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:24Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Creating volume 08a37fa4-209c-4098-ac8b-6291d459940f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:24 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:24 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f 1073741824 Apr 15 00:20:24 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92228d0-4480-447b-bbf7-25eaede92469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65b007c-247d-450c-9998-d53dca3f4ad9', 'volume_size': 2, 'source_volid': '646cedff-10ed-44e8-8a94-cad9a6ad8e0a', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea13e26-0a80-46bf-8431-0d0cd9da823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:24 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Volume volume-d65b007c-247d-450c-9998-d53dca3f4ad9 (d65b007c-247d-450c-9998-d53dca3f4ad9): created successfully Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea13e26-0a80-46bf-8431-0d0cd9da823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Flow 'volume_create_manager' (ebc4ed96-d97f-48c4-bcb3-0ee948ba9595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:24 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-09e2d9b6-e64f-41df-a744-772f07be1ffa tempest-VolumesCloneTest-1402464837 None] Created volume successfully. Apr 15 00:20:24 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f 1073741824" returned: 0 in 0.507s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:24 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f Apr 15 00:20:24 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:25 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f" returned: 0 in 0.448s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e899b0ac-6b68-4b5f-b42d-d508a5373b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a37fa4-209c-4098-ac8b-6291d459940f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508f6ad2-5611-49c8-8621-d2e87d0fe03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:25 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Volume volume-08a37fa4-209c-4098-ac8b-6291d459940f (08a37fa4-209c-4098-ac8b-6291d459940f): created successfully Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508f6ad2-5611-49c8-8621-d2e87d0fe03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (fa515c0c-794b-4cd9-b1cf-d22c3f7b88a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:25 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ab71c16b-4ddc-4287-a85b-9eb2c72e68f2 tempest-VolumesListAdminTestJSON-219548914 None] Created volume successfully. Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-d65b007c-247d-450c-9998-d53dca3f4ad9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "cinder-d65b007c-247d-450c-9998-d53dca3f4ad9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc1d743-8924-4597-a202-d49ea9ac9707]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:25 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 Apr 15 00:20:25 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:26 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:26 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9 Apr 15 00:20:26 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (ed7965e0-3fe9-42ac-8236-dcf1164cd8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0a7e6b-3c55-4ac9-a8af-fd52e2be49fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0a7e6b-3c55-4ac9-a8af-fd52e2be49fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-185389106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2876fe4e-046c-4fdf-b439-be60b1fe1910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:26Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a9d161-47de-4e15-b4f7-3d961e9f94d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a9d161-47de-4e15-b4f7-3d961e9f94d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adb0075-0e78-4245-b7a9-632a4e1bd60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adb0075-0e78-4245-b7a9-632a4e1bd60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2876fe4e-046c-4fdf-b439-be60b1fe1910', 'volume_name': 'volume-2876fe4e-046c-4fdf-b439-be60b1fe1910', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07fe579-1a6b-42fb-816c-bba7052abbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07fe579-1a6b-42fb-816c-bba7052abbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba96fa38-6401-474e-a6e6-59ecc2f7ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:26 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Volume 2876fe4e-046c-4fdf-b439-be60b1fe1910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2876fe4e-046c-4fdf-b439-be60b1fe1910', 'volume_size': 1} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-185389106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2876fe4e-046c-4fdf-b439-be60b1fe1910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:26Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Creating volume 2876fe4e-046c-4fdf-b439-be60b1fe1910 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:26 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:26 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 1073741824 Apr 15 00:20:26 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:26 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d65b007c-247d-450c-9998-d53dca3f4ad9" returned: 0 in 0.458s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-d65b007c-247d-450c-9998-d53dca3f4ad9" released by "delete_volume" :: held 0.986s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Created reservations ['ab9ad796-f6dd-49c1-8467-789a340eec89', '0359600e-a207-48df-b8a5-2f05aa020389', 'bff73e9b-4a00-4541-9a5c-dd3ffa3dd808', '2962385c-bb4e-41e7-b569-60577af637b9'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:26 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:26 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:26 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 1073741824" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:26 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 Apr 15 00:20:26 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:26 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.425s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:26 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Deleted volume successfully. Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-98a10118-3494-4791-a5bf-f38a91b7877f tempest-VolumesCloneTest-1402464837 None] Lock "cinder-d65b007c-247d-450c-9998-d53dca3f4ad9-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:27 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910" returned: 0 in 0.428s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba96fa38-6401-474e-a6e6-59ecc2f7ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2876fe4e-046c-4fdf-b439-be60b1fe1910', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1ba26e-cc38-4e51-933d-495c985bfb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Volume volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 (2876fe4e-046c-4fdf-b439-be60b1fe1910): created successfully Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1ba26e-cc38-4e51-933d-495c985bfb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (ed7965e0-3fe9-42ac-8236-dcf1164cd8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:27 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7421fd06-dfe3-4b59-b00d-09ee1efa777c tempest-VolumesListAdminTestJSON-219548914 None] Created volume successfully. Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-646cedff-10ed-44e8-8a94-cad9a6ad8e0a-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "cinder-646cedff-10ed-44e8-8a94-cad9a6ad8e0a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Acquiring lock "cinder-quobyte-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d1741e-4b3d-41c1-9d26-ecc1b69b2b74]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:27 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:27 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:28 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:28 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a Apr 15 00:20:28 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:28 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (6f7363af-0c64-4ac3-806c-6150925f73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d658004-e174-466a-a656-d3418206f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" returned: 0 in 0.516s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d658004-e174-466a-a656-d3418206f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1448550537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b75607-6b44-473e-bd55-cfc5161d0aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:29Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e287d8d-1e86-4bec-a1db-c40b30532ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e287d8d-1e86-4bec-a1db-c40b30532ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1728e1f-bd7b-4a93-b6b1-428b7aa295cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1728e1f-bd7b-4a93-b6b1-428b7aa295cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b75607-6b44-473e-bd55-cfc5161d0aca', 'volume_name': 'volume-08b75607-6b44-473e-bd55-cfc5161d0aca', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b9712f-90c4-49f5-a5ab-9e03bb47bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b9712f-90c4-49f5-a5ab-9e03bb47bad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbd2c7a-9450-4c45-8d30-ac18c4da9f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:28 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Volume 08b75607-6b44-473e-bd55-cfc5161d0aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b75607-6b44-473e-bd55-cfc5161d0aca', 'volume_size': 1} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1448550537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b75607-6b44-473e-bd55-cfc5161d0aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0c72681e0244e3ba2000397c19d41ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:29Z,use_quota=True,user_id='b46b8ccfeb9e4cb4b45448b64d7f2dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Creating volume 08b75607-6b44-473e-bd55-cfc5161d0aca {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:28 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "cinder-quobyte-646cedff-10ed-44e8-8a94-cad9a6ad8e0a" released by "delete_volume" :: held 1.087s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:28 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca 1073741824 Apr 15 00:20:28 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Created reservations ['e7df2174-a5ff-46ab-9316-64483a7694c8', 'eb3bf77a-407e-4982-9063-af581fb3eadb', '6a31cda4-8592-4f26-beb2-76bfa6ead0b9', 'ba2f176d-512d-455c-a2ba-f3b997b95136'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:28 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:28 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:29 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca 1073741824" returned: 0 in 0.485s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:29 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca Apr 15 00:20:29 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:29 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Deleted volume successfully. Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-be7aa769-8678-4d28-84e9-161d20e254d6 tempest-VolumesCloneTest-1402464837 None] Lock "cinder-646cedff-10ed-44e8-8a94-cad9a6ad8e0a-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:29 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbd2c7a-9450-4c45-8d30-ac18c4da9f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b75607-6b44-473e-bd55-cfc5161d0aca', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6664df-f573-4652-8c94-1254ca276883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Volume volume-08b75607-6b44-473e-bd55-cfc5161d0aca (08b75607-6b44-473e-bd55-cfc5161d0aca): created successfully Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6664df-f573-4652-8c94-1254ca276883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Flow 'volume_create_manager' (6f7363af-0c64-4ac3-806c-6150925f73d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ff00ccf3-9ac7-48c8-bd92-b2fa848573b0 tempest-VolumesListAdminTestJSON-219548914 None] Created volume successfully. Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Flow 'volume_create_manager' (31c627f2-4411-4e15-8859-cc77ecdaf0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b803a635-911e-43ac-8b02-2683468ddc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b803a635-911e-43ac-8b02-2683468ddc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2199722-a9da-46ad-baca-9cbaae233a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b368c8bd70a4ff5aad0285de8159820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:31Z,use_quota=True,user_id='2b578ef14dad47d0bdaa98e067389942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbf88a-1ee9-4643-bafc-d55683186c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbf88a-1ee9-4643-bafc-d55683186c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f3029-dbfe-49c8-8093-fd3f62dacee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c75f3029-dbfe-49c8-8093-fd3f62dacee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2199722-a9da-46ad-baca-9cbaae233a40', 'volume_name': 'volume-e2199722-a9da-46ad-baca-9cbaae233a40', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7de605-6304-481a-a9f2-e8601a043089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7de605-6304-481a-a9f2-e8601a043089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2886be-6a74-4b6f-a239-0b808c462810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Volume e2199722-a9da-46ad-baca-9cbaae233a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2199722-a9da-46ad-baca-9cbaae233a40', 'volume_size': 1} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2199722-a9da-46ad-baca-9cbaae233a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b368c8bd70a4ff5aad0285de8159820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:31Z,use_quota=True,user_id='2b578ef14dad47d0bdaa98e067389942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Creating volume e2199722-a9da-46ad-baca-9cbaae233a40 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:31 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:31 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 1073741824 Apr 15 00:20:31 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (19f699c7-3a5b-4ee2-948a-f404b49bb7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef79552e-90d4-428b-be6a-3c14af3f8f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef79552e-90d4-428b-be6a-3c14af3f8f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-323200670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89db9067-944b-4c71-863d-4f7d6e33603b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:31Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34078c17-9ade-4f38-bf86-5cdf771b42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34078c17-9ade-4f38-bf86-5cdf771b42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9a01a-05a0-4631-b1ab-b0dc31ace5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d9a01a-05a0-4631-b1ab-b0dc31ace5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89db9067-944b-4c71-863d-4f7d6e33603b', 'volume_name': 'volume-89db9067-944b-4c71-863d-4f7d6e33603b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d021a323-ca4d-40ec-b055-30a782aad50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d021a323-ca4d-40ec-b055-30a782aad50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e5a8fd-a628-41a2-9323-1f834ba7f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Volume 89db9067-944b-4c71-863d-4f7d6e33603b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89db9067-944b-4c71-863d-4f7d6e33603b', 'volume_size': 1} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:31 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 1073741824" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:31 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 Apr 15 00:20:31 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:32 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40" returned: 0 in 0.421s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-323200670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89db9067-944b-4c71-863d-4f7d6e33603b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:31Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Creating volume 89db9067-944b-4c71-863d-4f7d6e33603b {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:32 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2886be-6a74-4b6f-a239-0b808c462810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2199722-a9da-46ad-baca-9cbaae233a40', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2cb972-96a0-4730-af40-0f36368622af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:32 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b 1073741824 Apr 15 00:20:32 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:32 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Volume volume-e2199722-a9da-46ad-baca-9cbaae233a40 (e2199722-a9da-46ad-baca-9cbaae233a40): created successfully Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2cb972-96a0-4730-af40-0f36368622af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Flow 'volume_create_manager' (31c627f2-4411-4e15-8859-cc77ecdaf0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:32 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2051308b-17a5-46ea-a30d-5d1b789185e9 tempest-VolumesListAdminTestJSON-440627919 None] Created volume successfully. Apr 15 00:20:32 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b 1073741824" returned: 0 in 0.499s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:32 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b Apr 15 00:20:32 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:33 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b" returned: 0 in 0.428s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e5a8fd-a628-41a2-9323-1f834ba7f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89db9067-944b-4c71-863d-4f7d6e33603b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9ceb0c-97f3-4b1d-8fdd-3daf787eb073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:33 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Volume volume-89db9067-944b-4c71-863d-4f7d6e33603b (89db9067-944b-4c71-863d-4f7d6e33603b): created successfully Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9ceb0c-97f3-4b1d-8fdd-3daf787eb073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (19f699c7-3a5b-4ee2-948a-f404b49bb7e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:33 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-02a0b669-7116-43e2-964b-6ccb7e6a1182 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Acquiring lock "cinder-e2199722-a9da-46ad-baca-9cbaae233a40-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "cinder-e2199722-a9da-46ad-baca-9cbaae233a40-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Acquiring lock "cinder-quobyte-e2199722-a9da-46ad-baca-9cbaae233a40" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "cinder-quobyte-e2199722-a9da-46ad-baca-9cbaae233a40" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bbcd87-cbbb-494f-8cfe-4724f6a2ec75]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-08b75607-6b44-473e-bd55-cfc5161d0aca-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-08b75607-6b44-473e-bd55-cfc5161d0aca-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-quobyte-08b75607-6b44-473e-bd55-cfc5161d0aca" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:33 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 Apr 15 00:20:33 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-08b75607-6b44-473e-bd55-cfc5161d0aca" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105b03e-b408-4a95-b580-1a39a2d7085a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:33 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca Apr 15 00:20:33 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=153,cinder:UPDATE=197,cinder:INSERT=58,cinder:DELETE=20 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:34 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (6410e192-8738-4234-959e-6b1b8e4de0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea54bdc-8ce9-449e-934f-951af6c4e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40" returned: 0 in 0.572s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40 Apr 15 00:20:34 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea54bdc-8ce9-449e-934f-951af6c4e871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390608765',display_name='tempest-VolumesGetTest-Volume-775166867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b338705-176f-4684-9dc3-8b4e5b9563ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:34Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a79204d-5ea6-4582-9ad9-2620f0bf8f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a79204d-5ea6-4582-9ad9-2620f0bf8f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9253f85f-2709-44e1-9c5e-4b1484cc9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9253f85f-2709-44e1-9c5e-4b1484cc9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b338705-176f-4684-9dc3-8b4e5b9563ad', 'volume_name': 'volume-4b338705-176f-4684-9dc3-8b4e5b9563ad', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970ec146-2510-4836-a6c3-c1a31bef58cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970ec146-2510-4836-a6c3-c1a31bef58cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc277191-1392-42c8-9cf3-3adb19c8183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:34 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Volume 4b338705-176f-4684-9dc3-8b4e5b9563ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b338705-176f-4684-9dc3-8b4e5b9563ad', 'volume_size': 1} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1390608765',display_name='tempest-VolumesGetTest-Volume-775166867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b338705-176f-4684-9dc3-8b4e5b9563ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:34Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Creating volume 4b338705-176f-4684-9dc3-8b4e5b9563ad {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:34 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca" returned: 0 in 0.530s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad 1073741824 Apr 15 00:20:34 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca Apr 15 00:20:34 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2199722-a9da-46ad-baca-9cbaae233a40" returned: 0 in 0.419s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "cinder-quobyte-e2199722-a9da-46ad-baca-9cbaae233a40" released by "delete_volume" :: held 1.024s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Created reservations ['5d363c0b-3f69-4e84-bd89-30619494f5fd', '81430ab4-c37c-492b-ba75-728ba77dfba0', '7eae5ee9-02e8-4c45-bca8-05ab0d6e8c2a', '01d5bf57-fe94-4fc5-82c0-3ee3967edb69'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:34 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08b75607-6b44-473e-bd55-cfc5161d0aca" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-08b75607-6b44-473e-bd55-cfc5161d0aca" released by "delete_volume" :: held 1.018s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:34 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:34 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Created reservations ['e503cd49-91b7-415d-9424-fe545170dbd0', '640596ff-00c7-4abd-b075-14571219dedf', '39a5cadb-a14b-4b7c-bfbd-50b764315adf', '15fed6de-3c4c-4e61-a335-cf4ab7e05b48'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:34 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad 1073741824" returned: 0 in 0.557s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:34 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:34 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:34 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad Apr 15 00:20:34 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:35 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Deleted volume successfully. Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-79c04db1-3281-4128-90a6-a1f0428f7410 tempest-VolumesListAdminTestJSON-440627919 None] Lock "cinder-e2199722-a9da-46ad-baca-9cbaae233a40-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:35 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Deleted volume successfully. Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-86de7354-7ea0-471c-a8a6-e848a4982474 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-08b75607-6b44-473e-bd55-cfc5161d0aca-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:35 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc277191-1392-42c8-9cf3-3adb19c8183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b338705-176f-4684-9dc3-8b4e5b9563ad', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f210cb6-1280-4d24-b6fd-7b03a53758d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:35 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Volume volume-4b338705-176f-4684-9dc3-8b4e5b9563ad (4b338705-176f-4684-9dc3-8b4e5b9563ad): created successfully Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f210cb6-1280-4d24-b6fd-7b03a53758d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (6410e192-8738-4234-959e-6b1b8e4de0dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-77694d31-4a25-4d4e-b06a-9c0e5b99ea2c tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-2876fe4e-046c-4fdf-b439-be60b1fe1910-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-2876fe4e-046c-4fdf-b439-be60b1fe1910-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-quobyte-2876fe4e-046c-4fdf-b439-be60b1fe1910" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-2876fe4e-046c-4fdf-b439-be60b1fe1910" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec53ff-13f0-405e-99cb-34f111784b11]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:35 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 Apr 15 00:20:35 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-4b338705-176f-4684-9dc3-8b4e5b9563ad-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "cinder-4b338705-176f-4684-9dc3-8b4e5b9563ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:36 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-4b338705-176f-4684-9dc3-8b4e5b9563ad" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910" returned: 0 in 0.515s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-4b338705-176f-4684-9dc3-8b4e5b9563ad" acquired by "delete_volume" :: waited 0.028s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:36 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910 Apr 15 00:20:36 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb32a4-8d86-4386-94c7-fc5d7f51f694]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:36 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad Apr 15 00:20:36 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:36 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2876fe4e-046c-4fdf-b439-be60b1fe1910" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-2876fe4e-046c-4fdf-b439-be60b1fe1910" released by "delete_volume" :: held 0.953s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Created reservations ['497e80e1-c4b2-4ca7-b330-ef037077b0f0', '11491f01-bf9f-4833-97a2-4565c1dcff47', 'c92e3520-8a55-47dd-8bdd-731310b9e9e2', '3a1fe82d-8abd-4097-ae63-c112d5a39bbc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:36 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:36 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:36 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:36 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad Apr 15 00:20:36 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-08a37fa4-209c-4098-ac8b-6291d459940f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-08a37fa4-209c-4098-ac8b-6291d459940f-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "cinder-quobyte-08a37fa4-209c-4098-ac8b-6291d459940f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-08a37fa4-209c-4098-ac8b-6291d459940f" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c223eef4-d632-45ca-aa4b-fd750883fc96]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:37 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f Apr 15 00:20:37 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:37 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.441s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Deleted volume successfully. Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d90fa91-aa1e-4f10-a37e-05b11c846715 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-2876fe4e-046c-4fdf-b439-be60b1fe1910-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:37 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-4b338705-176f-4684-9dc3-8b4e5b9563ad" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-4b338705-176f-4684-9dc3-8b4e5b9563ad" released by "delete_volume" :: held 1.010s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Created reservations ['1d026af1-4055-4c0c-830f-196fe58ee350', '5cfec8e7-d87f-4095-93e6-b124ec2f5a82', '36b8523e-8e06-41f1-935a-55b6d61cf5cd', '7340dcf0-48a0-4f1c-b934-fe49d57c7191'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:37 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:37 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:37 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:37 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f Apr 15 00:20:37 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:37 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.402s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0a1e0652-6af1-48ba-a137-d5d9b0cd4b33 tempest-VolumesGetTest-1985976099 None] Lock "cinder-4b338705-176f-4684-9dc3-8b4e5b9563ad-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:37 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-08a37fa4-209c-4098-ac8b-6291d459940f" returned: 0 in 0.414s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-quobyte-08a37fa4-209c-4098-ac8b-6291d459940f" released by "delete_volume" :: held 0.945s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:37 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Created reservations ['b28f4b66-d14a-45fb-9915-53c012e53641', 'bd3852bf-1382-4291-8273-1fb786a44786', '579ef3c8-642a-47b9-9514-6e6eb3f19bc9', '31f8efbe-174d-4aef-96e9-77918ef20fec'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:38 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:38 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:38 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.435s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Deleted volume successfully. Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8aa84538-6963-4e2d-8602-4f8fdb1b1d36 tempest-VolumesListAdminTestJSON-219548914 None] Lock "cinder-08a37fa4-209c-4098-ac8b-6291d459940f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-89db9067-944b-4c71-863d-4f7d6e33603b-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "cinder-89db9067-944b-4c71-863d-4f7d6e33603b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-89db9067-944b-4c71-863d-4f7d6e33603b" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-89db9067-944b-4c71-863d-4f7d6e33603b" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[33700c79-3379-44f8-8118-27a77d0125f4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:38 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b Apr 15 00:20:38 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:39 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:39 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b Apr 15 00:20:39 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:39 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89db9067-944b-4c71-863d-4f7d6e33603b" returned: 0 in 0.437s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-89db9067-944b-4c71-863d-4f7d6e33603b" released by "delete_volume" :: held 0.933s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Created reservations ['6d1b50ac-fec9-47c5-8f9b-f5dc6e541ba9', '05a85c04-38c1-4515-b192-5fede8299fa4', 'a6ef28b1-ede3-4fde-a932-01b630c9d8f3', '6365ea0f-b050-437e-9e76-558c0c0434f3'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:39 devstack sudo[89454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:39 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (6d37766f-f940-4df2-9cd5-3fa1a7ab23ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb943ab-17d3-4463-a1d9-018045b0f924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb943ab-17d3-4463-a1d9-018045b0f924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-318809460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2050915-eb4f-433d-8131-884f695a3f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:40Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad7c8fa-4583-4e7f-a7f1-699d3f60704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad7c8fa-4583-4e7f-a7f1-699d3f60704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcbd07f-031a-4c3e-8932-71f18f86e391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bcbd07f-031a-4c3e-8932-71f18f86e391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2050915-eb4f-433d-8131-884f695a3f44', 'volume_name': 'volume-e2050915-eb4f-433d-8131-884f695a3f44', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aece6db1-aef4-45c1-93d2-a8d2bbc37716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aece6db1-aef4-45c1-93d2-a8d2bbc37716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4950d05-e778-4cec-a1e7-4237f97247c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:39 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Volume e2050915-eb4f-433d-8131-884f695a3f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2050915-eb4f-433d-8131-884f695a3f44', 'volume_size': 1} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-318809460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2050915-eb4f-433d-8131-884f695a3f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:40Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Creating volume e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:39 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:40 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 1073741824 Apr 15 00:20:40 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:40 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:40 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:20:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ef0bcf76-4bf9-441a-85a4-9653565e0044 tempest-VolumesGetTest-1985976099 None] Lock "cinder-89db9067-944b-4c71-863d-4f7d6e33603b-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:40 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 1073741824" returned: 0 in 0.602s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:40 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:20:40 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:41 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4950d05-e778-4cec-a1e7-4237f97247c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2050915-eb4f-433d-8131-884f695a3f44', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e3b495-527f-4a7d-a40d-e68b670d4215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Volume volume-e2050915-eb4f-433d-8131-884f695a3f44 (e2050915-eb4f-433d-8131-884f695a3f44): created successfully Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e3b495-527f-4a7d-a40d-e68b670d4215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (6d37766f-f940-4df2-9cd5-3fa1a7ab23ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a3b9710a-8968-4f55-87b8-a1e3714b7408 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:42 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:42 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (8e45cf36-e75b-49cd-9249-09e4afba24ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b628b3c-057c-4625-9454-e8f3b40a5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Flow 'volume_create_manager' (f06b2a06-105b-4fe4-993b-52388fc30719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e195d0-da7c-4287-86bb-97e63f2f46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b628b3c-057c-4625-9454-e8f3b40a5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-775081247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72494c42-8181-42d0-b3ba-6cd985170099,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e2050915-eb4f-433d-8131-884f695a3f44,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:42Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086a2d4-1c02-4d1a-8907-baec59c4242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086a2d4-1c02-4d1a-8907-baec59c4242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d83faea-2ff9-4ec4-82d3-d2b8416e9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e195d0-da7c-4287-86bb-97e63f2f46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2046705492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def2e511-6015-466d-aa11-85118982646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae67640b60bc40f68a1b9bf98abc5a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:42Z,use_quota=True,user_id='8489a695f4f543d09354d91a47dcb968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cc0cdb-9a0f-4dd3-9037-1d7bc6dec703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cc0cdb-9a0f-4dd3-9037-1d7bc6dec703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76b40e-9237-42c2-abbf-68a24328dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a76b40e-9237-42c2-abbf-68a24328dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def2e511-6015-466d-aa11-85118982646c', 'volume_name': 'volume-def2e511-6015-466d-aa11-85118982646c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51451bfc-97f8-49ff-8b7c-31021ca5ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51451bfc-97f8-49ff-8b7c-31021ca5ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea1d365-416b-42bb-8cd9-e714f03cfef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Volume def2e511-6015-466d-aa11-85118982646c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def2e511-6015-466d-aa11-85118982646c', 'volume_size': 1} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2046705492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def2e511-6015-466d-aa11-85118982646c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae67640b60bc40f68a1b9bf98abc5a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:42Z,use_quota=True,user_id='8489a695f4f543d09354d91a47dcb968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Creating volume def2e511-6015-466d-aa11-85118982646c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:42 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:42 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c 1073741824 Apr 15 00:20:42 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d83faea-2ff9-4ec4-82d3-d2b8416e9465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72494c42-8181-42d0-b3ba-6cd985170099', 'volume_name': 'volume-72494c42-8181-42d0-b3ba-6cd985170099', 'volume_size': 1, 'source_volid': 'e2050915-eb4f-433d-8131-884f695a3f44', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f294e5-775d-4f8c-bee8-bb3371498ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f294e5-775d-4f8c-bee8-bb3371498ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38f5420-dc5c-4f9f-b341-0317077e3445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:42 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Volume 72494c42-8181-42d0-b3ba-6cd985170099: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72494c42-8181-42d0-b3ba-6cd985170099', 'volume_size': 1, 'source_volid': 'e2050915-eb4f-433d-8131-884f695a3f44', 'source_volstatus': 'available'} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:42 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.422s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:42 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c 1073741824" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:42 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c Apr 15 00:20:42 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:43 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.890s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:43 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Cloning volume e2050915-eb4f-433d-8131-884f695a3f44 to volume 72494c42-8181-42d0-b3ba-6cd985170099 Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea1d365-416b-42bb-8cd9-e714f03cfef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def2e511-6015-466d-aa11-85118982646c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b3ad4b-2de6-437a-8c2f-9d446fcc0460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:43 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Volume volume-def2e511-6015-466d-aa11-85118982646c (def2e511-6015-466d-aa11-85118982646c): created successfully Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b3ad4b-2de6-437a-8c2f-9d446fcc0460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Flow 'volume_create_manager' (f06b2a06-105b-4fe4-993b-52388fc30719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Creating offline snapshot ba5c1eb6-baa1-49a4-b606-10909a6a1da3 of volume e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:20:43 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6cf9fc71-b420-4bd6-99cb-b934071383d3 tempest-VolumesTransfersTest-1339330363 None] Created volume successfully. Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b6a27a-3033-4764-b945-2d6353073814]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:43 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:20:43 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:43 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:43 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 1G Apr 15 00:20:43 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:44 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 1G" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2050915-eb4f-433d-8131-884f695a3f44 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:44 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2050915-eb4f-433d-8131-884f695a3f44 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:44 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:44 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-686be31e-5a96-4d10-bc78-4810f16ed9a7 tempest-VolumesTransfersTest-1462340397 None] Transfer volume completed successfully. Apr 15 00:20:44 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2050915-eb4f-433d-8131-884f695a3f44 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:44 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 is being set with open permissions: ugo+rw Apr 15 00:20:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:44 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:44 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:45 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.414s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:45 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info Apr 15 00:20:45 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "cinder-def2e511-6015-466d-aa11-85118982646c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-def2e511-6015-466d-aa11-85118982646c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "cinder-quobyte-def2e511-6015-466d-aa11-85118982646c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-quobyte-def2e511-6015-466d-aa11-85118982646c" acquired by "delete_volume" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fde845-b7a2-4652-830a-4dc7378a91c7]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:45 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c Apr 15 00:20:45 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:45 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:45 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info is being set with open permissions: ugo+rw Apr 15 00:20:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:45 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info Apr 15 00:20:45 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:46 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:46 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c Apr 15 00:20:46 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:46 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.info" returned: 0 in 0.422s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] snapshot: ba5c1eb6-baa1-49a4-b606-10909a6a1da3, volume: 72494c42-8181-42d0-b3ba-6cd985170099, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f72d2-b129-4855-bd1c-5ddc8b8f5fe4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:46 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:46 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:46 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-def2e511-6015-466d-aa11-85118982646c" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-quobyte-def2e511-6015-466d-aa11-85118982646c" released by "delete_volume" :: held 0.937s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Created reservations ['2e98f45a-ae7c-4228-a4e1-202670d6302f', '2b929151-44e8-49c2-bd29-d3425e4a5121', 'c857daf5-e561-4db2-8050-60d5647e3749', 'f7a0618a-5b5d-4d92-a6c4-f584ad5ad96d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:46 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:46 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:46 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.523s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2050915-eb4f-433d-8131-884f695a3f44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[582e91f8-b76e-4e10-843b-23677f910b07]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:46 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:20:46 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Flow 'volume_create_manager' (f08fcc88-528d-40b0-ba3c-7bdfa5763c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6e3efa-8870-4055-9869-677e9d73c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6e3efa-8870-4055-9869-677e9d73c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1216671337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c664852d-9dad-4006-9767-949064b388f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae67640b60bc40f68a1b9bf98abc5a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:47Z,use_quota=True,user_id='8489a695f4f543d09354d91a47dcb968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f05024-2e1a-4ff5-8df7-c21678027304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f05024-2e1a-4ff5-8df7-c21678027304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3487f7e1-2b1b-47b5-b63f-5c5d0064461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3487f7e1-2b1b-47b5-b63f-5c5d0064461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c664852d-9dad-4006-9767-949064b388f9', 'volume_name': 'volume-c664852d-9dad-4006-9767-949064b388f9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f774f7-dff6-4cc4-b0ab-3fc292a8c2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f774f7-dff6-4cc4-b0ab-3fc292a8c2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756ba8b7-6b9b-4f65-ae87-fe624fe6c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:47 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Volume c664852d-9dad-4006-9767-949064b388f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c664852d-9dad-4006-9767-949064b388f9', 'volume_size': 1} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:47 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Deleted volume successfully. Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2226251f-388e-4d8e-a313-0dcb19f83d05 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-def2e511-6015-466d-aa11-85118982646c-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:47 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.528s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:20:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:47 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 Apr 15 00:20:47 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:49 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099" returned: 0 in 2.019s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1524d041-2b7e-4b53-a6a8-0bace5a28c19]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:49 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:20:49 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:49 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.609s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:20:49 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Converted 1024.00 MB image at 506.80 MB/s Apr 15 00:20:49 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 is being set with open permissions: ugo+rw Apr 15 00:20:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:49 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 Apr 15 00:20:49 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:50 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" released by "_copy_volume_from_snapshot" :: held 4.137s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-ba5c1eb6-baa1-49a4-b606-10909a6a1da3" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-ba5c1eb6-baa1-49a4-b606-10909a6a1da3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Deleting offline snapshot ba5c1eb6-baa1-49a4-b606-10909a6a1da3 of volume e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] snapshot_file for this snap is: volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6e4af-fb65-4332-8fdf-41510dc195d6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:50 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:50 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:50 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2050915-eb4f-433d-8131-884f695a3f44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f55f1d-46a7-46dc-af00-f420e0d31beb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:50 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:20:50 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:51 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:51 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:51 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:51 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:51 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3 Apr 15 00:20:51 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:52 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44.ba5c1eb6-baa1-49a4-b606-10909a6a1da3" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-ba5c1eb6-baa1-49a4-b606-10909a6a1da3" released by "_delete_snapshot" :: held 1.878s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.872s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.261s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1216671337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c664852d-9dad-4006-9767-949064b388f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae67640b60bc40f68a1b9bf98abc5a19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:47Z,use_quota=True,user_id='8489a695f4f543d09354d91a47dcb968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Creating volume c664852d-9dad-4006-9767-949064b388f9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:52 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38f5420-dc5c-4f9f-b341-0317077e3445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72494c42-8181-42d0-b3ba-6cd985170099', 'volume_size': 1, 'source_volid': 'e2050915-eb4f-433d-8131-884f695a3f44', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:52 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 1073741824 Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb246a2-7b87-43f5-98d2-fe2571fbff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:52 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:52 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Volume volume-72494c42-8181-42d0-b3ba-6cd985170099 (72494c42-8181-42d0-b3ba-6cd985170099): created successfully Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb246a2-7b87-43f5-98d2-fe2571fbff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (8e45cf36-e75b-49cd-9249-09e4afba24ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:52 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-618f6da5-9c23-4637-b898-68a525bb5992 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:20:52 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 1073741824" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:52 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 Apr 15 00:20:52 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:53 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756ba8b7-6b9b-4f65-ae87-fe624fe6c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c664852d-9dad-4006-9767-949064b388f9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efc68cb-7e9c-41b4-8931-3f77e1fa1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (f3501e2b-1f19-4414-96d7-a7cbe5c31696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab40280-89fb-4c17-b9a1-bc9ec4b2f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Volume volume-c664852d-9dad-4006-9767-949064b388f9 (c664852d-9dad-4006-9767-949064b388f9): created successfully Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2efc68cb-7e9c-41b4-8931-3f77e1fa1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Flow 'volume_create_manager' (f08fcc88-528d-40b0-ba3c-7bdfa5763c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab40280-89fb-4c17-b9a1-bc9ec4b2f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-172037903',display_name='tempest-VolumesGetTest-Volume-1534526533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918858b8-6cc0-43fe-8329-9a4aafdcbfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:53Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34403780-5c3b-4161-96a4-90b0f6c112f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34403780-5c3b-4161-96a4-90b0f6c112f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b0cecb-2661-4e0a-be1d-8f306b99c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b0cecb-2661-4e0a-be1d-8f306b99c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918858b8-6cc0-43fe-8329-9a4aafdcbfcb', 'volume_name': 'volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d708669f-e316-4408-8cc8-48b4e1f3fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d708669f-e316-4408-8cc8-48b4e1f3fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219fc9bc-869b-4014-b9ef-1d17e04ac50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Volume 918858b8-6cc0-43fe-8329-9a4aafdcbfcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb', 'volume_size': 1} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-172037903',display_name='tempest-VolumesGetTest-Volume-1534526533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918858b8-6cc0-43fe-8329-9a4aafdcbfcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:53Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Creating volume 918858b8-6cc0-43fe-8329-9a4aafdcbfcb {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:20:53 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:53 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-475f97a6-817b-4ca6-8d16-b36480116dc9 tempest-VolumesTransfersTest-1339330363 None] Created volume successfully. Apr 15 00:20:53 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb 1073741824 Apr 15 00:20:53 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:53 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb 1073741824" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:53 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb Apr 15 00:20:53 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:54 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219fc9bc-869b-4014-b9ef-1d17e04ac50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868cb14a-7775-4a93-a06f-f7044fc322a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:54 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Volume volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb (918858b8-6cc0-43fe-8329-9a4aafdcbfcb): created successfully Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868cb14a-7775-4a93-a06f-f7044fc322a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (f3501e2b-1f19-4414-96d7-a7cbe5c31696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:54 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8086bac9-1d29-4861-b365-74aa360e5384 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "cinder-c664852d-9dad-4006-9767-949064b388f9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-c664852d-9dad-4006-9767-949064b388f9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "cinder-quobyte-c664852d-9dad-4006-9767-949064b388f9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-quobyte-c664852d-9dad-4006-9767-949064b388f9" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecebb8e-c18c-4849-b3f3-3728a3fd2237]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:54 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 Apr 15 00:20:54 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:55 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:55 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9 Apr 15 00:20:55 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-918858b8-6cc0-43fe-8329-9a4aafdcbfcb-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "cinder-918858b8-6cc0-43fe-8329-9a4aafdcbfcb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:55 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c664852d-9dad-4006-9767-949064b388f9" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-quobyte-c664852d-9dad-4006-9767-949064b388f9" released by "delete_volume" :: held 0.921s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" acquired by "delete_volume" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[680b0c69-4f2e-4b9e-b247-1bf39dd7ff0f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Created reservations ['9f59fac8-49dc-474a-af85-2570da099347', '559cb65c-be36-4dd3-8620-510ddb090a2d', '569945dd-97c6-4f00-a7c4-9e17abcfb549', '1cb58a63-ee7a-44ca-b515-7e2e1797d770'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:55 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb Apr 15 00:20:55 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:55 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:55 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:56 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" returned: 0 in 0.505s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:56 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb Apr 15 00:20:56 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:56 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Deleted volume successfully. Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c0d50963-9207-4787-b8e8-35a281e9bd22 tempest-VolumesTransfersTest-1655550651 None] Lock "cinder-c664852d-9dad-4006-9767-949064b388f9-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:56 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" returned: 0 in 0.445s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-918858b8-6cc0-43fe-8329-9a4aafdcbfcb" released by "delete_volume" :: held 0.972s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Created reservations ['0c528dae-a38f-40e5-b566-7851f45bf7ba', 'a399bf8b-7006-44fc-bfc5-99b3edc2aee7', '5612d8c6-6f69-4fd1-8a1d-3f26b5128116', 'cdd71134-0f27-4815-b895-132a64bb98bf'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:56 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:56 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:57 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-686a40fa-e493-47b4-a847-e815e9ac33e0 tempest-VolumesGetTest-1985976099 None] Lock "cinder-918858b8-6cc0-43fe-8329-9a4aafdcbfcb-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-72494c42-8181-42d0-b3ba-6cd985170099-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "cinder-72494c42-8181-42d0-b3ba-6cd985170099-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9942bd-20b1-4da6-9c5c-a691f4c47dfc]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:57 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 Apr 15 00:20:57 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:58 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099" returned: 0 in 0.553s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:58 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099 Apr 15 00:20:58 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:58 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72494c42-8181-42d0-b3ba-6cd985170099" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-72494c42-8181-42d0-b3ba-6cd985170099" released by "delete_volume" :: held 1.036s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Created reservations ['193df2e7-fa4c-4c5b-b575-354b317d12c8', 'f66e5744-2081-41e3-9b3c-b619154032be', 'b367f7b0-65c5-48ce-882b-a01471193ff0', 'b26dbbd5-5cb0-48be-91ee-8d51b62013fc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:20:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:58 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:20:58 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Flow 'volume_create_manager' (05baacc0-b332-42c0-88b1-70bc9a7ccf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579011eb-be21-4bb2-8a17-02233afd0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579011eb-be21-4bb2-8a17-02233afd0a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856220646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58bc21e-cebf-4834-967e-b1ca099a4840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77560ec16864851a64c1216ff273c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:59Z,use_quota=True,user_id='07b5c78c060146718ad97da9eeea2b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ef9810-4853-401b-b935-05cf59d62d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ef9810-4853-401b-b935-05cf59d62d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff4a60-5c01-40bc-ad97-d82faab14c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.image.glance [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Creating Keystone auth plugin from conf {{(pid=83219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 00:20:59 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.440s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:20:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7774608f-f38e-4278-bdb3-d9edbdcd2792 tempest-VolumesGetTest-1985976099 None] Lock "cinder-72494c42-8181-42d0-b3ba-6cd985170099-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ff4a60-5c01-40bc-ad97-d82faab14c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f58bc21e-cebf-4834-967e-b1ca099a4840', 'volume_name': 'volume-f58bc21e-cebf-4834-967e-b1ca099a4840', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b440d3-8a80-41ea-8432-560b7b4afe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b440d3-8a80-41ea-8432-560b7b4afe48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b911ffa-df88-49d4-90fd-24cbbbd376e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:20:59 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Volume f58bc21e-cebf-4834-967e-b1ca099a4840: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f58bc21e-cebf-4834-967e-b1ca099a4840', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Trying to clone f58bc21e-cebf-4834-967e-b1ca099a4840 from image bb201dba-017f-4c90-9496-4d9f4a01c76f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]). {{(pid=83219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 00:20:59 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Image download 20.69 MB at 20.69 MB/s Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f932e-9f7b-4b96-84a0-c09a61d31420]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:20:59 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD Apr 15 00:20:59 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-e2050915-eb4f-433d-8131-884f695a3f44-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "cinder-e2050915-eb4f-433d-8131-884f695a3f44-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-e2050915-eb4f-433d-8131-884f695a3f44" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-e2050915-eb4f-433d-8131-884f695a3f44" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[411c0c0e-319a-4082-9d15-812681b99619]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:20:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:00 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:21:00 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:00 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f is fetched for user 07b5c78c060146718ad97da9eeea2b40. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6cfa85-64bd-40ed-9101-340a886c21b0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:00 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD Apr 15 00:21:00 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:00 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:00 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44 Apr 15 00:21:00 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:00 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1856220646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58bc21e-cebf-4834-967e-b1ca099a4840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77560ec16864851a64c1216ff273c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:20:59Z,use_quota=True,user_id='07b5c78c060146718ad97da9eeea2b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Creating volume f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:00 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:00 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1073741824 Apr 15 00:21:00 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:00 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e2050915-eb4f-433d-8131-884f695a3f44" returned: 0 in 0.415s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-e2050915-eb4f-433d-8131-884f695a3f44" released by "delete_volume" :: held 0.945s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Created reservations ['48edd025-caf5-4dae-a797-6eb160f36359', 'a16fe709-28d8-4bd7-9c47-a523b504433a', 'ff3e9677-23c3-46ba-9f21-5a9104e83320', '05daf5e4-3a83-4d08-842f-7255b9498246'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:01 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:01 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:01 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1073741824" returned: 0 in 0.550s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:01 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:01 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:01 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (c57681d0-4cd1-4c51-97b2-5648c68c6999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83917bc6-06f8-4691-94b5-f44f68ba61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83917bc6-06f8-4691-94b5-f44f68ba61bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1239378178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2029ef7d-a5bd-4006-8a44-8e4cf2730c73,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:01Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d708ca84-a88d-408c-abd0-b2c6e36d83c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d708ca84-a88d-408c-abd0-b2c6e36d83c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea8a195-ddd9-4356-a9ec-b4bc706041cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.image.glance [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Creating Keystone auth plugin from conf {{(pid=83219) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 00:21:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04a76408-3779-45fd-9da5-ee93a0e164d6 tempest-VolumesGetTest-1985976099 None] Lock "cinder-e2050915-eb4f-433d-8131-884f695a3f44-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:01 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.456s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea8a195-ddd9-4356-a9ec-b4bc706041cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2029ef7d-a5bd-4006-8a44-8e4cf2730c73', 'volume_name': 'volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5d7faf-6138-4d55-9bff-b6e862902077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5d7faf-6138-4d55-9bff-b6e862902077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f1343f-f544-4aed-8db2-64c60f0487e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:01 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Trying to clone 2029ef7d-a5bd-4006-8a44-8e4cf2730c73 from image bb201dba-017f-4c90-9496-4d9f4a01c76f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]). {{(pid=83219) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Attempting download of bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume f58bc21e-cebf-4834-967e-b1ca099a4840. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f649dae1-bae9-40d2-97d4-5f6491530882]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:01 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a Apr 15 00:21:01 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 00:21:01 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Image download 20.69 MB at 20.69 MB/s Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd3c8eb-8b81-4de4-b08c-2b8df8e15e51]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:01 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD Apr 15 00:21:01 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:02 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:02 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a Apr 15 00:21:02 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:02 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f is fetched for user 5dd15c567f464fefb86499bb84773ad2. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34678dfc-2034-412a-b917-96ba19584814]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:02 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD Apr 15 00:21:02 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:02 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a" returned: 1 in 0.505s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_rt0f4t5a' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf290b-6d39-49c8-9ba9-64d232e17487]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:02 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD Apr 15 00:21:02 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:02 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1239378178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2029ef7d-a5bd-4006-8a44-8e4cf2730c73,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:01Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Creating volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:02 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:02 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1073741824 Apr 15 00:21:02 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:03 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] bb201dba-017f-4c90-9496-4d9f4a01c76f was qcow2, converting to raw {{(pid=83219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:03 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:03 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:03 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1073741824" returned: 0 in 0.544s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=126,cinder:INSERT=43,cinder:UPDATE=185,cinder:DELETE=16 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:21:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:03 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:03 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:04 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 0 in 0.539s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Attempting download of bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 00:21:04 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.869s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_yv7bbbw8devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:21:04 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb0395-affa-41c7-94a3-993a5062cb3b]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:04 devstack sudo[89722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1G Apr 15 00:21:04 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:04 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2 Apr 15 00:21:04 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:04 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 1G" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3f3e2-b77d-4c25-9779-8d7c1cff5f4b]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:04 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2" returned: 0 in 0.457s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:04 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:04 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:04 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2 Apr 15 00:21:04 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:04 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:04 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2" returned: 1 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bb201dba-017f-4c90-9496-4d9f4a01c76f_9yj2lou2' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[60460d9d-e1a0-4343-b126-e2e3433b163e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:05 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:05 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:05 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD Apr 15 00:21:05 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:05 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 1 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Downloaded image bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume f58bc21e-cebf-4834-967e-b1ca099a4840 successfully. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f for user 07b5c78c060146718ad97da9eeea2b40 is deleted. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Marking volume f58bc21e-cebf-4834-967e-b1ca099a4840 as bootable. {{(pid=83219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Copying metadata from image bb201dba-017f-4c90-9496-4d9f4a01c76f to f58bc21e-cebf-4834-967e-b1ca099a4840. {{(pid=83219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Creating volume glance metadata for volume f58bc21e-cebf-4834-967e-b1ca099a4840 backed by image bb201dba-017f-4c90-9496-4d9f4a01c76f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 00:21:05 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] bb201dba-017f-4c90-9496-4d9f4a01c76f was qcow2, converting to raw {{(pid=83219) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:05 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:05 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b911ffa-df88-49d4-90fd-24cbbbd376e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58bc21e-cebf-4834-967e-b1ca099a4840', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe6742e-5643-41bc-96b4-37f7fb5f422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:05 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Volume volume-f58bc21e-cebf-4834-967e-b1ca099a4840 (f58bc21e-cebf-4834-967e-b1ca099a4840): created successfully Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe6742e-5643-41bc-96b4-37f7fb5f422b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:05 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Flow 'volume_create_manager' (05baacc0-b332-42c0-88b1-70bc9a7ccf94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bd6be40c-b0c5-4b20-a20a-24eb05f3ac47 tempest-VolumesExtendTest-2089076707 None] Created volume successfully. Apr 15 00:21:06 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 0 in 0.802s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bb201dba-017f-4c90-9496-4d9f4a01c76f_7tp0ay9idevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:21:06 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:06 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1G Apr 15 00:21:06 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6fe48a-fe23-498b-b843-9025927a7fb1]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:06 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:06 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:06 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 1G" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0d7f4-a6ce-4141-992f-cec8c375d193]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:06 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:06 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:07 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.494s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:07 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:07 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:07 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:07 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:07 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:07 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 1 in 0.489s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 2G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 2G" returned: 0 in 0.043s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.057s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8e992c4e-407e-43ab-8069-5caa6cf8bbdf tempest-VolumesExtendTest-2089076707 None] Extend volume completed successfully. Apr 15 00:21:07 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 1 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Downloaded image bb201dba-017f-4c90-9496-4d9f4a01c76f ((None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}])) to volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73 successfully. {{(pid=83219) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Temporary image bb201dba-017f-4c90-9496-4d9f4a01c76f for user 5dd15c567f464fefb86499bb84773ad2 is deleted. {{(pid=83219) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.volume_utils [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Marking volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73 as bootable. {{(pid=83219) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Copying metadata from image bb201dba-017f-4c90-9496-4d9f4a01c76f to 2029ef7d-a5bd-4006-8a44-8e4cf2730c73. {{(pid=83219) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Creating volume glance metadata for volume 2029ef7d-a5bd-4006-8a44-8e4cf2730c73 backed by image bb201dba-017f-4c90-9496-4d9f4a01c76f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83219) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f1343f-f544-4aed-8db2-64c60f0487e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73', 'volume_size': 1, 'image_id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bb201dba-017f-4c90-9496-4d9f4a01c76f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '655c01fa1c4d4091b5bb33a51d4d6b2f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bb201dba-017f-4c90-9496-4d9f4a01c76f', 'created_at': datetime.datetime(2026, 4, 14, 22, 9, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 14, 22, 9, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bb201dba-017f-4c90-9496-4d9f4a01c76f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb179881-27d8-4bb1-945b-4da6f0b36f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:07 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Volume volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 (2029ef7d-a5bd-4006-8a44-8e4cf2730c73): created successfully Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb179881-27d8-4bb1-945b-4da6f0b36f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:07 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (c57681d0-4cd1-4c51-97b2-5648c68c6999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ed08c48c-62da-4eb2-b4d8-afb989712c30 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:21:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-f58bc21e-cebf-4834-967e-b1ca099a4840-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-f58bc21e-cebf-4834-967e-b1ca099a4840-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-quobyte-f58bc21e-cebf-4834-967e-b1ca099a4840" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-f58bc21e-cebf-4834-967e-b1ca099a4840" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce8bc69-efa1-4a69-80d8-fa7d02c868a1]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:09 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:09 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (249380da-9e3c-42db-b9bc-5bb327cbd471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036b9a07-1204-4c6f-b272-9ac824370023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036b9a07-1204-4c6f-b272-9ac824370023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1867512631',display_name='tempest-VolumesGetTest-Volume-2060473983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764de3b3-1b40-43cc-be9b-cb5abedb4ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:09Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8d9fcd-ae1c-432a-8aa7-dc970755caa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8d9fcd-ae1c-432a-8aa7-dc970755caa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e77c3f-cb1a-4bb1-a1e3-a821fcfc5ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e77c3f-cb1a-4bb1-a1e3-a821fcfc5ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '764de3b3-1b40-43cc-be9b-cb5abedb4ff1', 'volume_name': 'volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf8f531-9042-4b6d-8549-b47ec7229636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf8f531-9042-4b6d-8549-b47ec7229636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb126f3a-342f-4b05-9c44-9cd5b4870b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Volume 764de3b3-1b40-43cc-be9b-cb5abedb4ff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1', 'volume_size': 1} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1867512631',display_name='tempest-VolumesGetTest-Volume-2060473983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=764de3b3-1b40-43cc-be9b-cb5abedb4ff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4e9918a0fd4e45a918e631e548adf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:09Z,use_quota=True,user_id='5dd15c567f464fefb86499bb84773ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Creating volume 764de3b3-1b40-43cc-be9b-cb5abedb4ff1 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:09 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:09 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 1073741824 Apr 15 00:21:09 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:09 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.484s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:09 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:09 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:09 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 1073741824" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:09 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 Apr 15 00:21:09 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:09 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 1 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:10 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840 Apr 15 00:21:10 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:10 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb126f3a-342f-4b05-9c44-9cd5b4870b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1479f-64c0-4815-a96d-86f7ae52db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:10 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Volume volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 (764de3b3-1b40-43cc-be9b-cb5abedb4ff1): created successfully Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb1479f-64c0-4815-a96d-86f7ae52db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Flow 'volume_create_manager' (249380da-9e3c-42db-b9bc-5bb327cbd471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ac69f5fe-3a30-4be2-b87b-9d8b47e5f938 tempest-VolumesGetTest-1985976099 None] Created volume successfully. Apr 15 00:21:10 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f58bc21e-cebf-4834-967e-b1ca099a4840" returned: 0 in 0.436s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-f58bc21e-cebf-4834-967e-b1ca099a4840" released by "delete_volume" :: held 1.451s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Created reservations ['6621f358-fe8d-4db4-a47e-e6029abcbffa', '53c720aa-f157-41e3-a881-0826fcdd2569', 'bc0e7d2d-86e2-4e35-8110-9c9ea58099d4', 'e8163d7a-709b-4bbd-8a72-ea1488c47857'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:10 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:10 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:10 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.435s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Deleted volume successfully. Apr 15 00:21:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-65dc4ee4-d1a7-4fa3-b441-36896dfd9121 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-f58bc21e-cebf-4834-967e-b1ca099a4840-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Flow 'volume_create_manager' (33cad8a9-1742-4090-bfe9-8b12078e5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f748f3a-71ec-4466-8560-75675aff95e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f748f3a-71ec-4466-8560-75675aff95e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-668648433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2547aef5-301f-45b6-80a2-b27795a13a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77560ec16864851a64c1216ff273c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:11Z,use_quota=True,user_id='07b5c78c060146718ad97da9eeea2b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf67b5f7-a6ad-4ca4-9f78-0cd79a76d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf67b5f7-a6ad-4ca4-9f78-0cd79a76d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e686c7c-f601-4faf-b09e-64e30af3fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e686c7c-f601-4faf-b09e-64e30af3fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2547aef5-301f-45b6-80a2-b27795a13a21', 'volume_name': 'volume-2547aef5-301f-45b6-80a2-b27795a13a21', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a2d1b4-5a6c-429e-94c8-20cd8bf22d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a2d1b4-5a6c-429e-94c8-20cd8bf22d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f50f60d-4914-4022-8941-5fdfd2e39b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:11 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Volume 2547aef5-301f-45b6-80a2-b27795a13a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2547aef5-301f-45b6-80a2-b27795a13a21', 'volume_size': 1} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-668648433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2547aef5-301f-45b6-80a2-b27795a13a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f77560ec16864851a64c1216ff273c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:11Z,use_quota=True,user_id='07b5c78c060146718ad97da9eeea2b40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Creating volume 2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:11 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:11 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 1073741824 Apr 15 00:21:11 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-764de3b3-1b40-43cc-be9b-cb5abedb4ff1-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "cinder-764de3b3-1b40-43cc-be9b-cb5abedb4ff1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2003895-97cb-469f-89a4-a5d03a5a091d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:11 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 Apr 15 00:21:11 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:11 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 1073741824" returned: 0 in 0.529s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:11 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:11 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:12 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" returned: 0 in 0.504s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:12 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1 Apr 15 00:21:12 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:12 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.429s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f50f60d-4914-4022-8941-5fdfd2e39b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2547aef5-301f-45b6-80a2-b27795a13a21', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04c701e-4c4b-4e95-b6bb-c9bf8ab78d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Volume volume-2547aef5-301f-45b6-80a2-b27795a13a21 (2547aef5-301f-45b6-80a2-b27795a13a21): created successfully Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04c701e-4c4b-4e95-b6bb-c9bf8ab78d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Flow 'volume_create_manager' (33cad8a9-1742-4090-bfe9-8b12078e5040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a55e9ee1-1c9e-4ef7-87b7-41948002e405 tempest-VolumesExtendTest-2089076707 None] Created volume successfully. Apr 15 00:21:12 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" returned: 0 in 0.429s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-764de3b3-1b40-43cc-be9b-cb5abedb4ff1" released by "delete_volume" :: held 0.957s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Created reservations ['d178a8ca-d86f-4de6-be02-e5d9ec919a14', '0a1fc9b0-8c1d-4d37-b04a-1c8379933a07', '9c2f4fa6-7d7f-4a76-974c-0261c08c0fdc', '0533f6ac-1ddb-4877-900b-2a285a0692a0'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:12 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:12 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-2029ef7d-a5bd-4006-8a44-8e4cf2730c73-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "cinder-2029ef7d-a5bd-4006-8a44-8e4cf2730c73-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Acquiring lock "cinder-quobyte-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" acquired by "delete_volume" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2448323b-536a-4e01-af1b-b10e520d9c75]: (4, 'raw') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:12 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:12 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:12 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.448s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:12 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a8892c86-3e37-4720-b982-0598659d5e09 tempest-VolumesGetTest-1985976099 None] Lock "cinder-764de3b3-1b40-43cc-be9b-cb5abedb4ff1-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:13 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:13 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:13 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Creating offline snapshot 43254d60-dc3c-4f93-9658-619cc50a7d62 of volume 2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38fc010-5d29-4a1c-91b4-d4c96bcf5720]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:13 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:13 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:13 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 1 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73' failed. Not Retrying. {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 00:21:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:13 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73 Apr 15 00:21:13 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:14 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.491s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:14 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 1G Apr 15 00:21:14 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:14 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "cinder-quobyte-2029ef7d-a5bd-4006-8a44-8e4cf2730c73" released by "delete_volume" :: held 1.450s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Created reservations ['b1d33c3e-bd6a-47bf-9959-be94d3a53695', '3975e375-d364-4131-9a16-bba026b836a4', '36e211d2-2370-44ab-b5b1-ecc662550136', '65fc15db-69be-40ff-a5c6-e2788bbf5615'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:14 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:14 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:14 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 1G" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2547aef5-301f-45b6-80a2-b27795a13a21 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:14 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2547aef5-301f-45b6-80a2-b27795a13a21 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 Apr 15 00:21:14 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:14 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Deleted volume successfully. Apr 15 00:21:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e658fbdd-4f06-4a28-82e3-8fa2b42dc818 tempest-VolumesGetTest-1985976099 None] Lock "cinder-2029ef7d-a5bd-4006-8a44-8e4cf2730c73-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:15 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2547aef5-301f-45b6-80a2-b27795a13a21 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:15 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 is being set with open permissions: ugo+rw Apr 15 00:21:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:15 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 Apr 15 00:21:15 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:15 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62" returned: 0 in 0.494s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:15 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info Apr 15 00:21:15 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:16 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:16 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info is being set with open permissions: ugo+rw Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:16 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info Apr 15 00:21:16 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:16 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.info" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.914s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e28ac27c-98d4-470e-bde2-806b669c8f6f tempest-VolumesExtendTest-2089076707 None] Create snapshot completed successfully Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (8f3ec56f-a0e3-4865-99d8-cdfa7e4d94c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb2a702-5fa0-47a0-af42-de62d50e97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eb2a702-5fa0-47a0-af42-de62d50e97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-441404177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47101d5a-d0bc-4cce-aae9-2f667ddc6e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:17Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5ae90b-5058-45ed-bbbd-c59e9749da5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5ae90b-5058-45ed-bbbd-c59e9749da5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e417a913-1163-41c8-a7ee-9a86dcc80794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e417a913-1163-41c8-a7ee-9a86dcc80794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47101d5a-d0bc-4cce-aae9-2f667ddc6e7f', 'volume_name': 'volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d009f64-c2b5-4d0d-9692-dc72c0bcf8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d009f64-c2b5-4d0d-9692-dc72c0bcf8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84185392-f250-41f4-a044-d083b20b131c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Volume 47101d5a-d0bc-4cce-aae9-2f667ddc6e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f', 'volume_size': 1} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-441404177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47101d5a-d0bc-4cce-aae9-2f667ddc6e7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:17Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Creating volume 47101d5a-d0bc-4cce-aae9-2f667ddc6e7f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:16 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:16 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f 1073741824 Apr 15 00:21:16 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:17 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f 1073741824" returned: 0 in 0.497s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:17 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f Apr 15 00:21:17 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:17 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" returned: 0 in 0.412s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.796s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84185392-f250-41f4-a044-d083b20b131c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2368c9b5-1d53-487a-b8b2-2eaf77cecf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feabf90-8ce9-4f76-8c99-393edfcb4064]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:17 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Volume volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f (47101d5a-d0bc-4cce-aae9-2f667ddc6e7f): created successfully Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2368c9b5-1d53-487a-b8b2-2eaf77cecf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (8f3ec56f-a0e3-4865-99d8-cdfa7e4d94c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:17 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6ec33d5e-ef06-4cc1-8d6e-32289b69a978 tempest-VolumesListTestJSON-490850230 None] Created volume successfully. Apr 15 00:21:17 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:17 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:18 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.481s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 2G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 2G" returned: 0 in 0.065s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.572s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-007fd47f-f9f8-4c37-bd45-31c94895e5db tempest-VolumesExtendTest-2089076707 None] Extend volume completed successfully. Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (613abb62-8a23-4537-a83f-e82e135f8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd1ee58-1438-4858-9bbc-89c60142bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd1ee58-1438-4858-9bbc-89c60142bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1496246942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:19Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522f66e0-f90f-41df-9de5-72abdb4837c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522f66e0-f90f-41df-9de5-72abdb4837c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c29d9-5ef8-4a23-916e-13fcf9e9074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5c29d9-5ef8-4a23-916e-13fcf9e9074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e', 'volume_name': 'volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfaf83-92ea-455c-bdd8-64edc9fc7afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfaf83-92ea-455c-bdd8-64edc9fc7afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530b973-d2ac-4944-8ad6-454d052b755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:18 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Volume fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e', 'volume_size': 1} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1496246942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:19Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Creating volume fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:19 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-43254d60-dc3c-4f93-9658-619cc50a7d62-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-43254d60-dc3c-4f93-9658-619cc50a7d62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:19 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e 1073741824 Apr 15 00:21:19 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-quobyte-43254d60-dc3c-4f93-9658-619cc50a7d62" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-43254d60-dc3c-4f93-9658-619cc50a7d62" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Deleting offline snapshot 43254d60-dc3c-4f93-9658-619cc50a7d62 of volume 2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] snapshot_file for this snap is: volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ebea45-b049-4fa6-b765-4a01d0563b7e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:19 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 Apr 15 00:21:19 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:19 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e 1073741824" returned: 0 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:19 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e Apr 15 00:21:19 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:19 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2547aef5-301f-45b6-80a2-b27795a13a21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1962ca42-bc95-4d74-abf3-9dde3eb285ed]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:19 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:19 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:19 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b530b973-d2ac-4944-8ad6-454d052b755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5c4d8f-2a19-476e-ab3f-089cbbd7e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:19 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Volume volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e (fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e): created successfully Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5c4d8f-2a19-476e-ab3f-089cbbd7e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:19 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (613abb62-8a23-4537-a83f-e82e135f8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:19 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-30d32eb9-410b-45fa-be3c-82e2796155f8 tempest-VolumesListTestJSON-490850230 None] Created volume successfully. Apr 15 00:21:20 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:20 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 Apr 15 00:21:20 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:20 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:20 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62 Apr 15 00:21:20 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:20 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21.43254d60-dc3c-4f93-9658-619cc50a7d62" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-43254d60-dc3c-4f93-9658-619cc50a7d62" released by "_delete_snapshot" :: held 1.896s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" released by "delete_snapshot" :: held 1.904s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:20 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Created reservations ['f64f496a-dd9c-4ea1-83e6-ff4080a433da', 'e7ce89dc-5992-4ff9-9931-98625b620837', 'cd3ee782-be35-48f7-9044-e87f1ca7e7de', 'cb6fce0c-e9a6-40fb-96fc-05b7625a974d'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Delete snapshot completed successfully. Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9c67c705-2507-4712-a535-c48f418f7893 tempest-VolumesExtendTest-2089076707 None] Lock "cinder-43254d60-dc3c-4f93-9658-619cc50a7d62-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-2547aef5-301f-45b6-80a2-b27795a13a21-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "cinder-2547aef5-301f-45b6-80a2-b27795a13a21-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Acquiring lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefb80b0-0946-406e-b050-e6f822ab83d8]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:21 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:21 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (566d6cf1-571a-4ece-a891-6760e4500f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29a28a3-d1c9-4508-bd41-745d1ccd6ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29a28a3-d1c9-4508-bd41-745d1ccd6ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571052329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3a3c65-f84d-4c4d-8a07-39c9f2279956,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:21Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7be3409-d5d1-4daf-9880-0dbc156f975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7be3409-d5d1-4daf-9880-0dbc156f975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028e4b95-2d29-4cea-a2e7-981423cc7f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028e4b95-2d29-4cea-a2e7-981423cc7f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3a3c65-f84d-4c4d-8a07-39c9f2279956', 'volume_name': 'volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb3bfc3-3fd7-4df2-95f7-ac799cf6c341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb3bfc3-3fd7-4df2-95f7-ac799cf6c341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffea4c-3d5f-48a6-b6b5-59feb6a5e20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Volume ec3a3c65-f84d-4c4d-8a07-39c9f2279956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956', 'volume_size': 1} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1571052329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3a3c65-f84d-4c4d-8a07-39c9f2279956,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2af8e6acc312402980988afd5e4d3095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:21Z,use_quota=True,user_id='5aa8fef93dfc462494d63ad8ee6a0c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Creating volume ec3a3c65-f84d-4c4d-8a07-39c9f2279956 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:21 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:21 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 1073741824 Apr 15 00:21:21 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:21 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:21 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21 Apr 15 00:21:21 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:21 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 1073741824" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:21 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 Apr 15 00:21:21 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:22 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-2547aef5-301f-45b6-80a2-b27795a13a21" returned: 0 in 0.441s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "cinder-quobyte-2547aef5-301f-45b6-80a2-b27795a13a21" released by "delete_volume" :: held 0.954s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Created reservations ['cfdbf439-33f8-4e57-a1a3-3ed8204e54f3', '7af0b65e-d17e-45a4-b4ab-384d77435f78', '5a32b5cb-2e5d-48c3-96ce-496dd473ee12', '27de691d-d37d-450f-a4f9-b8d64ca0a134'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:22 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:22 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:22 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbffea4c-3d5f-48a6-b6b5-59feb6a5e20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17654d27-ea3c-4efd-8e05-670ba6d6e507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:22 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Volume volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 (ec3a3c65-f84d-4c4d-8a07-39c9f2279956): created successfully Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17654d27-ea3c-4efd-8e05-670ba6d6e507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Flow 'volume_create_manager' (566d6cf1-571a-4ece-a891-6760e4500f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-126d01ff-8b88-457f-b7e2-f2b92d5bba54 tempest-VolumesListTestJSON-490850230 None] Created volume successfully. Apr 15 00:21:22 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.510s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:22 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Deleted volume successfully. Apr 15 00:21:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-db54ff35-b8b3-4d9d-9a18-fb618c922f6d tempest-VolumesExtendTest-2089076707 None] Lock "cinder-2547aef5-301f-45b6-80a2-b27795a13a21-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-ec3a3c65-f84d-4c4d-8a07-39c9f2279956-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-ec3a3c65-f84d-4c4d-8a07-39c9f2279956-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-quobyte-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb1e6d-d00c-4d61-9b6e-535845dc552a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:25 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 Apr 15 00:21:25 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:25 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:25 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956 Apr 15 00:21:25 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:26 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" returned: 0 in 0.409s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-ec3a3c65-f84d-4c4d-8a07-39c9f2279956" released by "delete_volume" :: held 0.900s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Created reservations ['e2ce5351-0fb1-4767-acdc-38e863e3f547', '49380e79-edb3-48b2-bd07-e7967b29bc5f', 'cdb3739e-0e80-4e02-bbe5-e1242996cfd6', 'a80da343-22e9-47d9-b253-1e787119be56'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:26 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:26 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-quobyte-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0ab7b0-91ba-4f57-97df-869611e0d041]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:26 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e Apr 15 00:21:26 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:26 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Deleted volume successfully. Apr 15 00:21:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f97075db-4ef0-48f7-b16a-f49edeffd636 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-ec3a3c65-f84d-4c4d-8a07-39c9f2279956-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:27 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:27 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e Apr 15 00:21:27 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:27 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e" released by "delete_volume" :: held 0.914s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Created reservations ['24b4b12b-78a7-48e7-b765-53d92b02bb88', '8dae2470-24ce-442d-94a6-405346b25eec', 'e3c1c69a-aa9a-46cf-abaa-35f09b95acb4', '0cb9bd22-07e4-4e2c-ae33-10376a2e03fb'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:27 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:27 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "cinder-quobyte-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d449490b-aee0-4799-8077-a74a4881ca68]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:27 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f Apr 15 00:21:27 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:28 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.438s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Deleted volume successfully. Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0cadfa6-4fcb-4cb1-8ba4-47313409b3f9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-fc5a500b-cc13-4aca-a6f4-fa27a0c3ff2e-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:28 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:28 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f Apr 15 00:21:28 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:28 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-quobyte-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f" released by "delete_volume" :: held 0.943s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Created reservations ['5abe5c83-4a98-4a0d-a96c-3b34c532209b', '29065667-22e6-438c-aaca-ab541c7088b5', '3f855491-8cae-42ea-bcf5-9e81cedf473d', '1827ddc2-0fb8-4012-b803-367f44b7e832'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:28 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:28 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:29 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:29 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Deleted volume successfully. Apr 15 00:21:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-df85d884-b077-4705-b1cb-6f10142ecdc9 tempest-VolumesListTestJSON-490850230 None] Lock "cinder-47101d5a-d0bc-4cce-aae9-2f667ddc6e7f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Flow 'volume_create_manager' (d17a0c9b-ca7e-4667-8ae9-4f2066b3a8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3bd26a-7889-464a-94ab-9829934b92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3bd26a-7889-464a-94ab-9829934b92f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1516024324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba84c91-5f2d-456c-89ea-3f50541e583c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbc232ac168499683e82b58cf269b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:30Z,use_quota=True,user_id='f337bebe5bb04e71a40061d7c4f361a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152a9bdf-f8cc-45fa-b607-0dbd1459f34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152a9bdf-f8cc-45fa-b607-0dbd1459f34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69631be8-34a5-434e-99ef-1efa12efe303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69631be8-34a5-434e-99ef-1efa12efe303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba84c91-5f2d-456c-89ea-3f50541e583c', 'volume_name': 'volume-6ba84c91-5f2d-456c-89ea-3f50541e583c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d57d80-383b-4169-81af-1b55177de7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d57d80-383b-4169-81af-1b55177de7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0641e525-eb70-42d4-b592-1164501bd15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:30 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Volume 6ba84c91-5f2d-456c-89ea-3f50541e583c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba84c91-5f2d-456c-89ea-3f50541e583c', 'volume_size': 1} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1516024324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba84c91-5f2d-456c-89ea-3f50541e583c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bbc232ac168499683e82b58cf269b65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:30Z,use_quota=True,user_id='f337bebe5bb04e71a40061d7c4f361a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Creating volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:30 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:30 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c 1073741824 Apr 15 00:21:30 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:31 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c 1073741824" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:31 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c Apr 15 00:21:31 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:31 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0641e525-eb70-42d4-b592-1164501bd15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba84c91-5f2d-456c-89ea-3f50541e583c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03f0f4-4ee2-4086-baa3-f979ab09c954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Volume volume-6ba84c91-5f2d-456c-89ea-3f50541e583c (6ba84c91-5f2d-456c-89ea-3f50541e583c): created successfully Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e03f0f4-4ee2-4086-baa3-f979ab09c954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Flow 'volume_create_manager' (d17a0c9b-ca7e-4667-8ae9-4f2066b3a8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0dee2c49-9779-4d9a-b7d8-ccf9647f7a1f tempest-VolumesSnapshotListTestJSON-343387096 None] Created volume successfully. Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Creating offline snapshot 26a07c05-7254-4517-950c-3715af90f446 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256922b-2b72-410e-ac0b-6941ae5e6c22]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:31 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c Apr 15 00:21:31 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:32 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:32 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 1G Apr 15 00:21:32 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:32 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 1G" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:32 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:32 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:33 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.436s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:33 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 is being set with open permissions: ugo+rw Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:33 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:33 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:33 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:33 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info Apr 15 00:21:33 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:33 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info" returned: 0 in 0.421s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:33 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info is being set with open permissions: ugo+rw Apr 15 00:21:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:33 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info Apr 15 00:21:33 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:34 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.info" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=139,cinder:INSERT=61,cinder:UPDATE=202,cinder:DELETE=17 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:21:34 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-48962814-5f30-4ec5-89ea-1833d5b868ae tempest-VolumesSnapshotListTestJSON-343387096 None] Create snapshot completed successfully Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Creating offline snapshot 6edca510-abe2-4d8a-a3c3-67f88ec7c486 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19b06a-c6cb-4645-a727-f7cf91be7758]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:34 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:34 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:35 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:35 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 1G Apr 15 00:21:35 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:35 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 1G" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:35 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:35 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:36 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:36 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 is being set with open permissions: ugo+rw Apr 15 00:21:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:36 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:36 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:36 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fb96c57b-e334-41a9-bd87-7bca235945b0 tempest-VolumesSnapshotListTestJSON-343387096 None] Create snapshot completed successfully Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Creating offline snapshot 5f6f597b-9ae1-4695-950d-45f744c2fea0 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2396f20e-7420-419d-8f84-ac935b88ceeb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:37 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:37 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:37 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:37 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 1G Apr 15 00:21:37 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:38 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 1G" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:38 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 Apr 15 00:21:38 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:38 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0" returned: 0 in 0.438s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:38 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 is being set with open permissions: ugo+rw Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:38 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 Apr 15 00:21:38 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:38 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0" returned: 0 in 0.414s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0b708f02-78a5-4634-8dc3-f1ca2cd9e94a tempest-VolumesSnapshotListTestJSON-343387096 None] Create snapshot completed successfully Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-5f6f597b-9ae1-4695-950d-45f744c2fea0-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-5f6f597b-9ae1-4695-950d-45f744c2fea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" acquired by "delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-5f6f597b-9ae1-4695-950d-45f744c2fea0" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-5f6f597b-9ae1-4695-950d-45f744c2fea0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Deleting offline snapshot 5f6f597b-9ae1-4695-950d-45f744c2fea0 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] snapshot_file for this snap is: volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd474a7-28ed-4a74-9cf1-92fefa583788]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:39 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 Apr 15 00:21:39 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:40 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0" returned: 0 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba68d4e-0215-48e3-b52c-af4384d1f954]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:40 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:40 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:40 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.454s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:40 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 Apr 15 00:21:40 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:41 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:41 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0 Apr 15 00:21:41 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:41 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.5f6f597b-9ae1-4695-950d-45f744c2fea0" returned: 0 in 0.392s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-5f6f597b-9ae1-4695-950d-45f744c2fea0" released by "_delete_snapshot" :: held 1.848s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" released by "delete_snapshot" :: held 1.863s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Created reservations ['7c2e4d91-0dca-4bcd-ab75-d7045ffa441c', 'fb40b2c2-daa9-4254-90b9-d1f26e242e07', '43bdcaf5-5573-4ed0-a17c-9053efa2fa7f', 'ec410d43-e564-4804-b102-9864d04cd1e7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:41 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Delete snapshot completed successfully. Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f7d2dfcf-b73b-4020-bf32-1e443e293689 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-5f6f597b-9ae1-4695-950d-45f744c2fea0-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-6edca510-abe2-4d8a-a3c3-67f88ec7c486-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-6edca510-abe2-4d8a-a3c3-67f88ec7c486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-6edca510-abe2-4d8a-a3c3-67f88ec7c486" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6edca510-abe2-4d8a-a3c3-67f88ec7c486" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Deleting offline snapshot 6edca510-abe2-4d8a-a3c3-67f88ec7c486 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] snapshot_file for this snap is: volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[91967cdd-b29b-4e3c-8717-914d35cc27a0]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:41 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:41 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:42 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:42 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:42 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79c679-ba9d-4633-ab3a-e6edfd4e9fc5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:42 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:42 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:42 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.419s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:42 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:42 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:42 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:43 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:43 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486 Apr 15 00:21:43 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:43 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.6edca510-abe2-4d8a-a3c3-67f88ec7c486" returned: 0 in 0.411s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6edca510-abe2-4d8a-a3c3-67f88ec7c486" released by "_delete_snapshot" :: held 1.874s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" released by "delete_snapshot" :: held 1.885s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Created reservations ['fdf72d71-6ee8-423d-a572-68aa33a41143', '3e46307e-2585-4a76-8d04-93ffcde9310a', '316ef3ca-6be6-4186-adca-878752cd3368', '4d989ba4-681f-4755-aa56-893a90da047c'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:43 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Delete snapshot completed successfully. Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-ba9c9cd1-6c99-4d47-8849-96c3fee65fe3 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-6edca510-abe2-4d8a-a3c3-67f88ec7c486-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-26a07c05-7254-4517-950c-3715af90f446-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-26a07c05-7254-4517-950c-3715af90f446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-26a07c05-7254-4517-950c-3715af90f446" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-26a07c05-7254-4517-950c-3715af90f446" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Deleting offline snapshot 26a07c05-7254-4517-950c-3715af90f446 of volume 6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] snapshot_file for this snap is: volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b71d9a-8b54-46b1-a702-8b3e77855e5b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:44 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:44 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:44 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba84c91-5f2d-456c-89ea-3f50541e583c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd69b7f9-ec98-4cf1-914a-70a60fbad9f9]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:44 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c Apr 15 00:21:44 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:44 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c" returned: 0 in 0.466s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:44 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:44 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:45 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:45 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446 Apr 15 00:21:45 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:45 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c.26a07c05-7254-4517-950c-3715af90f446" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-26a07c05-7254-4517-950c-3715af90f446" released by "_delete_snapshot" :: held 1.840s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" released by "delete_snapshot" :: held 1.852s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Created reservations ['beeee1f0-07b4-436c-b888-359b036299db', 'eb2a94fd-7882-47bf-808e-960bc188ed66', '2eeea586-7bee-4dd2-a34b-5fb0884dcf13', '6436ff71-295f-4b35-ae80-a12be9382b75'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:45 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Delete snapshot completed successfully. Apr 15 00:21:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-caadab2d-53c8-4d32-a350-56f5a206c8e5 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-26a07c05-7254-4517-950c-3715af90f446-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-6ba84c91-5f2d-456c-89ea-3f50541e583c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-6ba84c91-5f2d-456c-89ea-3f50541e583c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aafe14-c17b-4672-8d80-4a60735ca388]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:46 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c Apr 15 00:21:46 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:46 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c" returned: 0 in 0.452s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:46 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c Apr 15 00:21:46 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:47 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6ba84c91-5f2d-456c-89ea-3f50541e583c" returned: 0 in 0.411s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-quobyte-6ba84c91-5f2d-456c-89ea-3f50541e583c" released by "delete_volume" :: held 0.899s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Created reservations ['106dbcb3-5b39-4869-bcb8-636c02a94adf', '24d35410-d385-4af6-8a6a-d1fa1dc44f85', 'fa051d5d-0905-41c6-8aa8-6a2652c0740b', '1229adce-43a3-4a0c-96c6-1b6304cadfbf'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:47 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:21:47 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:47 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.448s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:21:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Deleted volume successfully. Apr 15 00:21:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-63770fd1-29a8-4129-aed9-10489dc77ff7 tempest-VolumesSnapshotListTestJSON-343387096 None] Lock "cinder-6ba84c91-5f2d-456c-89ea-3f50541e583c-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (4d51633d-0e2f-4169-a4f1-5812a86ca5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bbb13c-2c85-4690-bb1f-3dda3f251449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bbb13c-2c85-4690-bb1f-3dda3f251449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624305271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d42e1d-de24-4a26-9c6f-cab43d0f21d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:49Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e577c30f-a9f3-4ea1-aff3-e9e38643cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e577c30f-a9f3-4ea1-aff3-e9e38643cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7da5417-fedd-46df-aa44-57edcddbd471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7da5417-fedd-46df-aa44-57edcddbd471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d42e1d-de24-4a26-9c6f-cab43d0f21d8', 'volume_name': 'volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7795cb-e934-4400-9fc8-7f33746e0a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7795cb-e934-4400-9fc8-7f33746e0a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6dd10-898a-445b-90bf-ccdfd46ab025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:48 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Volume 03d42e1d-de24-4a26-9c6f-cab43d0f21d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8', 'volume_size': 1} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-624305271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d42e1d-de24-4a26-9c6f-cab43d0f21d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:49Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Creating volume 03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:48 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:21:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:48 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 1073741824 Apr 15 00:21:48 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:49 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 1073741824" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:49 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:49 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:49 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d6dd10-898a-445b-90bf-ccdfd46ab025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537989fd-38f7-426a-9818-aff704cb0c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:49 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Volume volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 (03d42e1d-de24-4a26-9c6f-cab43d0f21d8): created successfully Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537989fd-38f7-426a-9818-aff704cb0c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (4d51633d-0e2f-4169-a4f1-5812a86ca5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c485c8cc-8b8f-43d3-b5bc-e0e2eda76509 tempest-VolumeDependencyTests-491800489 None] Created volume successfully. Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Creating offline snapshot b0686fcc-a412-4433-a70c-437b16e3081a of volume 03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e2e85-f288-40be-ab6e-c18cb9586aac]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:50 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:50 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:50 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.486s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:50 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a 1G Apr 15 00:21:50 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:50 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a 1G" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:50 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:50 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:51 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.422s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:51 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a is being set with open permissions: ugo+rw Apr 15 00:21:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:51 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:51 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:51 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:51 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info Apr 15 00:21:51 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:52 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:52 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info is being set with open permissions: ugo+rw Apr 15 00:21:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:52 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info Apr 15 00:21:52 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:52 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.info" returned: 0 in 0.410s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:52 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-240296a0-cb7c-48b4-88c7-ca27df7888d5 tempest-VolumeDependencyTests-491800489 None] Create snapshot completed successfully Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (c0ae1a91-5299-4431-8762-7fe57a8043e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6926c52e-c006-4b43-b46a-545ba5fe737f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6926c52e-c006-4b43-b46a-545ba5fe737f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1105185670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35121d5-9346-447c-9994-0d8397534b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0686fcc-a412-4433-a70c-437b16e3081a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:21:53Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b0fd1b-43eb-4834-8f12-07ecc632bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b0fd1b-43eb-4834-8f12-07ecc632bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa719a-27d8-402a-b7ad-dae56a904d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fa719a-27d8-402a-b7ad-dae56a904d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a35121d5-9346-447c-9994-0d8397534b52', 'volume_name': 'volume-a35121d5-9346-447c-9994-0d8397534b52', 'volume_size': 1, 'snapshot_id': 'b0686fcc-a412-4433-a70c-437b16e3081a'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80db2e0-4da4-473b-9b4f-25562864db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80db2e0-4da4-473b-9b4f-25562864db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0456f74-1171-445e-b92d-94a9927b9585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:53 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Volume a35121d5-9346-447c-9994-0d8397534b52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a35121d5-9346-447c-9994-0d8397534b52', 'volume_size': 1, 'snapshot_id': 'b0686fcc-a412-4433-a70c-437b16e3081a'} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a-a35121d5-9346-447c-9994-0d8397534b52" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a-a35121d5-9346-447c-9994-0d8397534b52" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Creating volume a35121d5-9346-447c-9994-0d8397534b52 from snapshot b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] snapshot: b0686fcc-a412-4433-a70c-437b16e3081a, volume: a35121d5-9346-447c-9994-0d8397534b52, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0da4733-4f93-41c6-88f0-08f2d3d0a3f3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:53 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:53 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:53 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.460s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e3b1d-4ce7-48a0-8980-15d5a1c3ae0d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:53 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:53 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:54 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:54 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:21:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:54 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 Apr 15 00:21:54 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:56 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52" returned: 0 in 1.888s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b38a7b-26e7-4911-a0ef-36621c221071]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:56 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:56 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:56 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.597s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:21:56 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Converted 1024.00 MB image at 542.02 MB/s Apr 15 00:21:56 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 is being set with open permissions: ugo+rw Apr 15 00:21:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:56 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 Apr 15 00:21:56 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:57 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" released by "_copy_volume_from_snapshot" :: held 3.863s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a-a35121d5-9346-447c-9994-0d8397534b52" released by "_create_volume_from_snapshot" :: held 3.878s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.888s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0456f74-1171-445e-b92d-94a9927b9585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35121d5-9346-447c-9994-0d8397534b52', 'volume_size': 1, 'snapshot_id': 'b0686fcc-a412-4433-a70c-437b16e3081a'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d5edae-f634-47f7-8151-c0a3973773cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:21:57 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Volume volume-a35121d5-9346-447c-9994-0d8397534b52 (a35121d5-9346-447c-9994-0d8397534b52): created successfully Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d5edae-f634-47f7-8151-c0a3973773cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (c0ae1a91-5299-4431-8762-7fe57a8043e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:21:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9e60b74a-d079-4b1c-9121-5335119869b4 tempest-VolumeDependencyTests-491800489 None] Created volume successfully. Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-b0686fcc-a412-4433-a70c-437b16e3081a-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-b0686fcc-a412-4433-a70c-437b16e3081a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Deleting offline snapshot b0686fcc-a412-4433-a70c-437b16e3081a of volume 03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] snapshot_file for this snap is: volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c321dd0d-4bc9-4d4c-a3d7-96fc364dab7e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:57 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:57 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:58 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.488s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e6057d-00c8-4d99-9c37-b5b4e3949419]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:58 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:58 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:58 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:58 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:58 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:59 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.439s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:59 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a Apr 15 00:21:59 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:21:59 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8.b0686fcc-a412-4433-a70c-437b16e3081a" returned: 0 in 0.402s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-b0686fcc-a412-4433-a70c-437b16e3081a" released by "_delete_snapshot" :: held 1.865s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" released by "delete_snapshot" :: held 1.877s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Created reservations ['8721bd6d-ceee-4af7-ba32-67dbb678aef8', '9bd8ce4d-3dcf-4aa9-a2d9-853581c84829', 'edd5482a-1505-41c0-93aa-6fb22580af0f', '84f6d9c0-c299-4bf8-a37b-5c6e59aa675e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:21:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Delete snapshot completed successfully. Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8fcfbfad-3961-45be-9193-be8008f4b4b6 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-b0686fcc-a412-4433-a70c-437b16e3081a-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-03d42e1d-de24-4a26-9c6f-cab43d0f21d8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-03d42e1d-de24-4a26-9c6f-cab43d0f21d8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e4a6e1-704b-4d22-8248-8060c9657396]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:21:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:21:59 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:21:59 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:00 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:00 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8 Apr 15 00:22:00 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:00 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" returned: 0 in 0.404s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-03d42e1d-de24-4a26-9c6f-cab43d0f21d8" released by "delete_volume" :: held 0.901s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Created reservations ['db2c137c-3390-4a93-8598-8261c782ca60', '21317d56-a412-402f-aa55-c41cadf3e169', '8fc62158-4c74-43d4-9975-372274673a31', 'fc00b8e2-c6c8-470b-9dd0-22a55bf246fc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:00 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:00 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (af26e40c-9f49-4422-944a-7d58b782e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc56f812-463e-44a0-a366-5ab2e5a598f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc56f812-463e-44a0-a366-5ab2e5a598f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-456898876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:01Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ca853a-c57d-44de-93f8-34e042f4d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ca853a-c57d-44de-93f8-34e042f4d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2eae3e-d2d0-4a81-8c7f-e66af72ea5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2eae3e-d2d0-4a81-8c7f-e66af72ea5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'volume_name': 'volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88ae41-4e44-4667-bb63-4f011f954a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df88ae41-4e44-4667-bb63-4f011f954a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76798b46-e2d8-444f-b026-4c7da5d91776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:01 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Volume 6d7311ae-7d39-43e3-a4c5-055e0fb5a15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'volume_size': 1} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-456898876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:01Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Creating volume 6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:22:01 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:01 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f 1073741824 Apr 15 00:22:01 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:01 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.461s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Deleted volume successfully. Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0f87a927-fbf4-4c2a-9124-f6cbff2852e2 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-03d42e1d-de24-4a26-9c6f-cab43d0f21d8-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:01 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f 1073741824" returned: 0 in 0.470s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:01 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:01 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:02 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.413s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76798b46-e2d8-444f-b026-4c7da5d91776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3600caac-dbab-438c-848f-9c8d4303195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:02 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Volume volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f (6d7311ae-7d39-43e3-a4c5-055e0fb5a15f): created successfully Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3600caac-dbab-438c-848f-9c8d4303195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:02 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (af26e40c-9f49-4422-944a-7d58b782e62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e9593af8-f764-4d49-9278-b0a9125eaec5 tempest-VolumeDependencyTests-491800489 None] Created volume successfully. Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (c233641c-e18c-4514-aa62-26ea4cb96eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13171f4d-5acc-4830-8d5f-1ebaeacb0393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13171f4d-5acc-4830-8d5f-1ebaeacb0393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-573370279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f2012d-273b-4616-b5eb-1a3eacfc14f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fcdcb3ebc4da6b519565f16028cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:03Z,use_quota=True,user_id='f6216be9348449d3ab6c55538e2bf937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f40e1c-5244-4c55-8d82-8cfccbc40aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f40e1c-5244-4c55-8d82-8cfccbc40aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d887762d-9bad-41e9-82e8-8b304aeb13b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d887762d-9bad-41e9-82e8-8b304aeb13b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '89f2012d-273b-4616-b5eb-1a3eacfc14f8', 'volume_name': 'volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8', 'volume_size': 1, 'source_volid': '6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986eca29-f207-4385-8109-300778d27eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986eca29-f207-4385-8109-300778d27eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3192644-c551-4ab7-8bdc-97ca722aa928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:03 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Volume 89f2012d-273b-4616-b5eb-1a3eacfc14f8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8', 'volume_size': 1, 'source_volid': '6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'source_volstatus': 'available'} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:03 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Cloning volume 6d7311ae-7d39-43e3-a4c5-055e0fb5a15f to volume 89f2012d-273b-4616-b5eb-1a3eacfc14f8 Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Creating offline snapshot 1bef03b5-3367-4b26-8d3a-6af9ca510c62 of volume 6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73fe6ff-d772-4fda-be15-e01adb8b0c65]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:03 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:03 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:03 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.455s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:03 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 1G Apr 15 00:22:03 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:04 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 1G" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:04 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:04 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:04 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.419s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:04 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 is being set with open permissions: ugo+rw Apr 15 00:22:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:04 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:04 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:05 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:05 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=151,cinder:SELECT=138,cinder:INSERT=52,cinder:DELETE=11 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:22:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:05 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info Apr 15 00:22:05 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:05 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:05 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info is being set with open permissions: ugo+rw Apr 15 00:22:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:05 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info Apr 15 00:22:05 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:06 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.info" returned: 0 in 0.415s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] snapshot: 1bef03b5-3367-4b26-8d3a-6af9ca510c62, volume: 89f2012d-273b-4616-b5eb-1a3eacfc14f8, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b24a9-4ef5-4fd0-ba10-270f84e8d192]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:06 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:06 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:06 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[94145099-34db-4ec5-8ca7-3de4d5092ad5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:06 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:06 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:07 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:07 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:22:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:07 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 Apr 15 00:22:07 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:09 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8" returned: 0 in 1.935s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a8df21-3a65-483c-872c-436222933fdf]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:09 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:09 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:09 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.585s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:22:09 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Converted 1024.00 MB image at 528.82 MB/s Apr 15 00:22:09 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 is being set with open permissions: ugo+rw Apr 15 00:22:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:09 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 Apr 15 00:22:09 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:10 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8" returned: 0 in 0.403s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" released by "_copy_volume_from_snapshot" :: held 3.908s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-1bef03b5-3367-4b26-8d3a-6af9ca510c62" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-1bef03b5-3367-4b26-8d3a-6af9ca510c62" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Deleting offline snapshot 1bef03b5-3367-4b26-8d3a-6af9ca510c62 of volume 6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] snapshot_file for this snap is: volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7949a8-02cd-4bd6-9d2f-704e06e95d93]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:10 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:10 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:10 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.462s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c948d-e77f-4de3-8899-0b7e0bc26e98]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:10 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:10 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:11 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:11 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:11 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:11 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:11 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62 Apr 15 00:22:11 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:11 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f.1bef03b5-3367-4b26-8d3a-6af9ca510c62" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-1bef03b5-3367-4b26-8d3a-6af9ca510c62" released by "_delete_snapshot" :: held 1.844s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.452s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3192644-c551-4ab7-8bdc-97ca722aa928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8', 'volume_size': 1, 'source_volid': '6d7311ae-7d39-43e3-a4c5-055e0fb5a15f', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97b4b68-9fda-4dea-a1ef-bf2b3708041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:11 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Volume volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 (89f2012d-273b-4616-b5eb-1a3eacfc14f8): created successfully Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e97b4b68-9fda-4dea-a1ef-bf2b3708041f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Flow 'volume_create_manager' (c233641c-e18c-4514-aa62-26ea4cb96eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-57cd0c2e-cc36-4e2b-9674-8646e46177db tempest-VolumeDependencyTests-491800489 None] Created volume successfully. Apr 15 00:22:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:12 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[befacb99-e457-4e7e-9780-0654563a07f2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:13 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:13 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:13 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.483s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:13 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f Apr 15 00:22:13 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:13 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" returned: 0 in 0.397s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f" released by "delete_volume" :: held 0.919s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Created reservations ['ef52c4bf-dcac-4ece-a4e4-5f3a6007044f', 'c2ec0c89-b7bd-4d8d-b0bd-2aa7acdd5258', 'b522b420-9dc8-4b90-8265-6f3e2c443ace', '5800d8d7-3b95-4b37-baef-afb6495f42d7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:14 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:14 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-89f2012d-273b-4616-b5eb-1a3eacfc14f8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-89f2012d-273b-4616-b5eb-1a3eacfc14f8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[193c932c-80bb-467e-9769-5f5890396acb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:14 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 Apr 15 00:22:14 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:14 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Deleted volume successfully. Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8197c385-9c7e-4444-86b2-5bca4f996ff1 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-6d7311ae-7d39-43e3-a4c5-055e0fb5a15f-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:14 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:14 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8 Apr 15 00:22:14 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:15 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-89f2012d-273b-4616-b5eb-1a3eacfc14f8" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-89f2012d-273b-4616-b5eb-1a3eacfc14f8" released by "delete_volume" :: held 0.907s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Created reservations ['2fc2bae9-c3f7-47a2-9b06-61e877306fa5', '1b7a8ab9-aef9-40ee-bf26-673bb1678d60', 'de15095a-f8fb-4a63-887d-e0297f5b7254', '019df692-b382-43e3-b7a5-e355b00a4632'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:15 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:15 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-a35121d5-9346-447c-9994-0d8397534b52-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "cinder-a35121d5-9346-447c-9994-0d8397534b52-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Acquiring lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e785171-d007-4050-91fe-59be0edae635]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:15 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 Apr 15 00:22:15 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:15 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.438s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:15 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Deleted volume successfully. Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b0ae87d-f218-46f5-9efb-5351edf10c36 tempest-VolumeDependencyTests-491800489 None] Lock "cinder-89f2012d-273b-4616-b5eb-1a3eacfc14f8-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:15 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52" returned: 0 in 0.468s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:15 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52 Apr 15 00:22:15 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:16 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a35121d5-9346-447c-9994-0d8397534b52" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "cinder-quobyte-a35121d5-9346-447c-9994-0d8397534b52" released by "delete_volume" :: held 0.904s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Created reservations ['bd945372-97ec-4c89-acbc-fd22ea197b26', 'd6f9afd4-8ac7-4d28-89b7-9713764f3aca', 'a3f23086-0625-4117-9f29-061d1b953626', '0f92f911-9600-4e25-a8a3-e370aef22615'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:16 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:16 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:16 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.458s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Deleted volume successfully. Apr 15 00:22:16 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-cdae1a1e-3f84-45d1-85e6-d58facad171a tempest-VolumeDependencyTests-491800489 None] Lock "cinder-a35121d5-9346-447c-9994-0d8397534b52-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:17 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:17 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Flow 'volume_create_manager' (6d3d422c-1043-493c-bd4c-8302c0e894b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0143b3a8-b747-42bf-b295-81afaffcc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0143b3a8-b747-42bf-b295-81afaffcc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034e9816-3498-4540-af92-9bd083aa2fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40539167560641b6829d9f341801cc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:18Z,use_quota=True,user_id='a2eb5212327c462ba5bf4f9bb26827a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec86352-1bb1-4eb7-b37f-381062e126fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec86352-1bb1-4eb7-b37f-381062e126fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e618ae0-bd7c-48fe-b4d6-6e9e034a2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e618ae0-bd7c-48fe-b4d6-6e9e034a2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034e9816-3498-4540-af92-9bd083aa2fcc', 'volume_name': 'volume-034e9816-3498-4540-af92-9bd083aa2fcc', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55387d1-8e9f-4ad1-b267-3614a6c76232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55387d1-8e9f-4ad1-b267-3614a6c76232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91033104-81e5-4b2e-8498-2227a3e4f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Volume 034e9816-3498-4540-af92-9bd083aa2fcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034e9816-3498-4540-af92-9bd083aa2fcc', 'volume_size': 1} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034e9816-3498-4540-af92-9bd083aa2fcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40539167560641b6829d9f341801cc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:18Z,use_quota=True,user_id='a2eb5212327c462ba5bf4f9bb26827a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Creating volume 034e9816-3498-4540-af92-9bd083aa2fcc {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:22:18 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:18 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc 1073741824 Apr 15 00:22:18 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:18 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc 1073741824" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:18 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc Apr 15 00:22:18 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:18 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc" returned: 0 in 0.403s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91033104-81e5-4b2e-8498-2227a3e4f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034e9816-3498-4540-af92-9bd083aa2fcc', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985aeaa6-1244-46b1-b6f2-7a092ef25e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:18 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Volume volume-034e9816-3498-4540-af92-9bd083aa2fcc (034e9816-3498-4540-af92-9bd083aa2fcc): created successfully Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985aeaa6-1244-46b1-b6f2-7a092ef25e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:18 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Flow 'volume_create_manager' (6d3d422c-1043-493c-bd4c-8302c0e894b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:18 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-698144bb-3a43-4096-918b-f776eeaaa7fe tempest-CinderUnicodeTest-1720763923 None] Created volume successfully. Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Flow 'volume_create_manager' (7fbdb401-9b51-45e8-8d24-95546c49aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364a602c-3cd2-4674-8f5d-c4fc1d9c8d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364a602c-3cd2-4674-8f5d-c4fc1d9c8d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1752034518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e4ac21-808b-4c34-959d-39b331aaac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40539167560641b6829d9f341801cc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:20Z,use_quota=True,user_id='a2eb5212327c462ba5bf4f9bb26827a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0d6edc-507f-42cf-aea4-4acd0b00dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0d6edc-507f-42cf-aea4-4acd0b00dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816518b3-8eb1-4c0f-8367-a48d1b9922b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (816518b3-8eb1-4c0f-8367-a48d1b9922b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e4ac21-808b-4c34-959d-39b331aaac22', 'volume_name': 'volume-23e4ac21-808b-4c34-959d-39b331aaac22', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c83cd-98e8-4621-bb70-d50d95c57be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c83cd-98e8-4621-bb70-d50d95c57be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61127eb2-9263-4983-b909-329f91bdd84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:20 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Volume 23e4ac21-808b-4c34-959d-39b331aaac22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e4ac21-808b-4c34-959d-39b331aaac22', 'volume_size': 1} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1752034518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e4ac21-808b-4c34-959d-39b331aaac22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40539167560641b6829d9f341801cc1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:20Z,use_quota=True,user_id='a2eb5212327c462ba5bf4f9bb26827a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Creating volume 23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:22:20 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:20 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 1073741824 Apr 15 00:22:20 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:20 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 1073741824" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:20 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 Apr 15 00:22:20 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:21 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22" returned: 0 in 0.406s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61127eb2-9263-4983-b909-329f91bdd84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e4ac21-808b-4c34-959d-39b331aaac22', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b425ee-56ba-4eb3-a60e-e98545bbb431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Volume volume-23e4ac21-808b-4c34-959d-39b331aaac22 (23e4ac21-808b-4c34-959d-39b331aaac22): created successfully Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04b425ee-56ba-4eb3-a60e-e98545bbb431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Flow 'volume_create_manager' (7fbdb401-9b51-45e8-8d24-95546c49aadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d6302512-9e2c-4673-a9f7-262babcd98b8 tempest-CinderUnicodeTest-1720763923 None] Created volume successfully. Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Creating offline snapshot c776cd85-7820-4b2b-9f5c-7594db8168b8 of volume 23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a072ba5-bdeb-4fb1-b38e-158cbd326b24]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:21 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 Apr 15 00:22:21 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:22 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:22 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 1G Apr 15 00:22:22 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:22 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 1G" returned: 0 in 0.461s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e4ac21-808b-4c34-959d-39b331aaac22 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:22 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e4ac21-808b-4c34-959d-39b331aaac22 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 Apr 15 00:22:22 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:22 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e4ac21-808b-4c34-959d-39b331aaac22 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8" returned: 0 in 0.423s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:22 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 is being set with open permissions: ugo+rw Apr 15 00:22:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:22 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 Apr 15 00:22:22 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:23 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:23 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info Apr 15 00:22:23 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:23 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info" returned: 0 in 0.407s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:23 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info is being set with open permissions: ugo+rw Apr 15 00:22:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:23 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info Apr 15 00:22:23 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:24 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.info" returned: 0 in 0.401s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:24 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b03d3c91-e305-4299-ae1a-5ddeca31a6d4 tempest-CinderUnicodeTest-1720763923 None] Create snapshot completed successfully Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-c776cd85-7820-4b2b-9f5c-7594db8168b8-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-c776cd85-7820-4b2b-9f5c-7594db8168b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-quobyte-c776cd85-7820-4b2b-9f5c-7594db8168b8" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-c776cd85-7820-4b2b-9f5c-7594db8168b8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Deleting offline snapshot c776cd85-7820-4b2b-9f5c-7594db8168b8 of volume 23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] snapshot_file for this snap is: volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[91706ada-bd9d-4fd1-a47c-100cf3da381f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:24 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 Apr 15 00:22:24 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:25 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8" returned: 0 in 0.468s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e4ac21-808b-4c34-959d-39b331aaac22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a754e-a871-4ae6-b202-b92b51775319]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:25 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 Apr 15 00:22:25 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:25 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22" returned: 0 in 0.453s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:25 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 Apr 15 00:22:25 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:26 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8" returned: 0 in 0.441s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:26 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8 Apr 15 00:22:26 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:26 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22.c776cd85-7820-4b2b-9f5c-7594db8168b8" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-c776cd85-7820-4b2b-9f5c-7594db8168b8" released by "_delete_snapshot" :: held 1.811s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" released by "delete_snapshot" :: held 1.824s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Created reservations ['5055a199-2e27-46b6-9815-7aba5d6d9970', '284f0579-d6e8-47be-b822-e887e037dc9c', '6162f27a-d0ac-4b94-bd67-4a0d42cb7b8b', '9c6c2e50-bac7-432c-badf-0539f4c88fdc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Delete snapshot completed successfully. Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8104ecf2-a482-4f5a-99bc-49b95675683a tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-c776cd85-7820-4b2b-9f5c-7594db8168b8-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-23e4ac21-808b-4c34-959d-39b331aaac22-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-23e4ac21-808b-4c34-959d-39b331aaac22-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" acquired by "delete_volume" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0e8fe4-42ad-4edc-82ca-d70d95b8e4e2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:26 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 Apr 15 00:22:26 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:27 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22" returned: 0 in 0.467s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:27 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22 Apr 15 00:22:27 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:27 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-23e4ac21-808b-4c34-959d-39b331aaac22" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-23e4ac21-808b-4c34-959d-39b331aaac22" released by "delete_volume" :: held 0.910s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Created reservations ['e775747d-2789-4515-bc99-286d405634f0', '4772f0bc-3c46-4335-846f-4da102015413', '26fdd1ab-1e8d-4c61-badc-d60f70059f5b', '1128846c-ff57-4ec3-8ec9-02874ef09ba3'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:27 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:27 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-034e9816-3498-4540-af92-9bd083aa2fcc-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-034e9816-3498-4540-af92-9bd083aa2fcc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "cinder-quobyte-034e9816-3498-4540-af92-9bd083aa2fcc" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-034e9816-3498-4540-af92-9bd083aa2fcc" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4073a6-f618-4b2b-9645-61c6533962d9]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:28 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc Apr 15 00:22:28 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:28 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Deleted volume successfully. Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-6b775b96-98ec-48e0-a809-356e9eb7db2c tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-23e4ac21-808b-4c34-959d-39b331aaac22-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:28 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:28 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc Apr 15 00:22:28 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:28 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-034e9816-3498-4540-af92-9bd083aa2fcc" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-quobyte-034e9816-3498-4540-af92-9bd083aa2fcc" released by "delete_volume" :: held 0.914s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Created reservations ['319fcb6d-fc06-40f9-a459-4eb3a41f62f0', '85bbd30d-6a6e-46e3-a1fc-9b420295a5cb', '559e2bc3-f41c-4a14-ba58-65b113d335ce', '9c12418f-fced-480c-b4ab-00f3a5b9a15a'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:28 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:28 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:29 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.439s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:29 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Deleted volume successfully. Apr 15 00:22:29 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-0b7f4022-64e1-4b67-bd5e-b1e09616e8c0 tempest-CinderUnicodeTest-1720763923 None] Lock "cinder-034e9816-3498-4540-af92-9bd083aa2fcc-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:38 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=53,cinder:SELECT=38,cinder:DELETE=5,cinder:INSERT=13 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:22:39 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=90,cinder:UPDATE=105,cinder:DELETE=9,cinder:INSERT=28 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Flow 'volume_create_manager' (b1ab86af-7654-4e3d-a74e-128b86075b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105356c0-62a5-4986-8928-ac7deb84652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105356c0-62a5-4986-8928-ac7deb84652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824276912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1284aa-fb9c-44fd-9380-985af4970e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e514877a124159b4337d2172889091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:42Z,use_quota=True,user_id='380e2033b26f4ec286ea5c80a86fe120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a755e54b-80af-4cfa-86e8-ba0569feea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a755e54b-80af-4cfa-86e8-ba0569feea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec85e7c-c478-47cb-8a63-e665a8d933c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec85e7c-c478-47cb-8a63-e665a8d933c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1284aa-fb9c-44fd-9380-985af4970e8a', 'volume_name': 'volume-6a1284aa-fb9c-44fd-9380-985af4970e8a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d041c8-fd0c-495a-86dc-669a9d32e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d041c8-fd0c-495a-86dc-669a9d32e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bd783c-d19b-4889-a376-be5ed49184c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:41 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Volume 6a1284aa-fb9c-44fd-9380-985af4970e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1284aa-fb9c-44fd-9380-985af4970e8a', 'volume_size': 1} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824276912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1284aa-fb9c-44fd-9380-985af4970e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e514877a124159b4337d2172889091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:42Z,use_quota=True,user_id='380e2033b26f4ec286ea5c80a86fe120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Creating volume 6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:22:41 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:22:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:42 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a 1073741824 Apr 15 00:22:42 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:42 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:42 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:42 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a 1073741824" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:42 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:42 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:42 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.471s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:42 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39bd783c-d19b-4889-a376-be5ed49184c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1284aa-fb9c-44fd-9380-985af4970e8a', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d2e982-0364-4693-b867-3aa2760f48b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:42 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Volume volume-6a1284aa-fb9c-44fd-9380-985af4970e8a (6a1284aa-fb9c-44fd-9380-985af4970e8a): created successfully Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d2e982-0364-4693-b867-3aa2760f48b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:42 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Flow 'volume_create_manager' (b1ab86af-7654-4e3d-a74e-128b86075b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-46627df2-9570-457b-bf43-2cf48ccb22f6 tempest-SnapshotDependencyTests-1672721195 None] Created volume successfully. Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Creating offline snapshot 6572f793-7d81-428b-a8c3-6b6ff0f404fd of volume 6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6732d62-c608-4178-a104-64040e41ef2f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:44 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:44 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:44 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:44 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd 1G Apr 15 00:22:44 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:45 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd 1G" returned: 0 in 0.459s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1284aa-fb9c-44fd-9380-985af4970e8a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:45 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1284aa-fb9c-44fd-9380-985af4970e8a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:45 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:45 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a1284aa-fb9c-44fd-9380-985af4970e8a -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.423s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:45 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd is being set with open permissions: ugo+rw Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:45 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:45 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:45 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:45 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info Apr 15 00:22:45 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:46 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info" returned: 0 in 0.409s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:46 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info is being set with open permissions: ugo+rw Apr 15 00:22:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:46 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info Apr 15 00:22:46 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:46 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.info" returned: 0 in 0.405s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.612s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5da35bb9-7ec5-43a5-aa8f-7a3de6f63a33 tempest-SnapshotDependencyTests-1672721195 None] Create snapshot completed successfully Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Flow 'volume_create_manager' (7ed734f3-0539-4032-a800-ecc993440c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da747042-6640-40cc-bc34-759d834d26e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da747042-6640-40cc-bc34-759d834d26e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bc0026-edb2-4832-84b5-209d261bc05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e514877a124159b4337d2172889091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6572f793-7d81-428b-a8c3-6b6ff0f404fd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:22:48Z,use_quota=True,user_id='380e2033b26f4ec286ea5c80a86fe120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4cc2bb-70f1-4c11-8eee-80f7bcb2c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4cc2bb-70f1-4c11-8eee-80f7bcb2c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f392b9-5abd-4604-9c21-297931840bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f392b9-5abd-4604-9c21-297931840bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4bc0026-edb2-4832-84b5-209d261bc05f', 'volume_name': 'volume-b4bc0026-edb2-4832-84b5-209d261bc05f', 'volume_size': 1, 'snapshot_id': '6572f793-7d81-428b-a8c3-6b6ff0f404fd'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16faa092-246d-4a8b-bc71-53e430852a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16faa092-246d-4a8b-bc71-53e430852a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aa1dec-cfe8-47dc-8f17-cc28cbf9c778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:47 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Volume b4bc0026-edb2-4832-84b5-209d261bc05f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4bc0026-edb2-4832-84b5-209d261bc05f', 'volume_size': 1, 'snapshot_id': '6572f793-7d81-428b-a8c3-6b6ff0f404fd'} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd-b4bc0026-edb2-4832-84b5-209d261bc05f" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd-b4bc0026-edb2-4832-84b5-209d261bc05f" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Creating volume b4bc0026-edb2-4832-84b5-209d261bc05f from snapshot 6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] snapshot: 6572f793-7d81-428b-a8c3-6b6ff0f404fd, volume: b4bc0026-edb2-4832-84b5-209d261bc05f, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[800705b3-00a3-4028-81ec-3b6820f7688c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:47 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:47 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:48 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a1284aa-fb9c-44fd-9380-985af4970e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0680a5f-522e-4f63-8998-5790900ae9aa]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:48 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:48 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:48 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:22:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:48 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f Apr 15 00:22:48 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:50 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f" returned: 0 in 1.844s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:50 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d25cee8-bd8c-471e-a8a2-f05ce19499de]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:50 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:50 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:51 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.605s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:22:51 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Converted 1024.00 MB image at 554.92 MB/s Apr 15 00:22:51 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f is being set with open permissions: ugo+rw Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:51 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f Apr 15 00:22:51 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:51 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f" returned: 0 in 0.400s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" released by "_copy_volume_from_snapshot" :: held 3.836s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd-b4bc0026-edb2-4832-84b5-209d261bc05f" released by "_create_volume_from_snapshot" :: held 3.851s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.857s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97aa1dec-cfe8-47dc-8f17-cc28cbf9c778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bc0026-edb2-4832-84b5-209d261bc05f', 'volume_size': 1, 'snapshot_id': '6572f793-7d81-428b-a8c3-6b6ff0f404fd'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ed4aec-1f9d-4272-ad9a-b2893debe80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:22:51 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Volume volume-b4bc0026-edb2-4832-84b5-209d261bc05f (b4bc0026-edb2-4832-84b5-209d261bc05f): created successfully Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ed4aec-1f9d-4272-ad9a-b2893debe80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Flow 'volume_create_manager' (7ed734f3-0539-4032-a800-ecc993440c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:22:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-2ee04783-408b-4f55-b5d7-44f511c410a4 tempest-SnapshotDependencyTests-1672721195 None] Created volume successfully. Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-6572f793-7d81-428b-a8c3-6b6ff0f404fd-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-6572f793-7d81-428b-a8c3-6b6ff0f404fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Deleting offline snapshot 6572f793-7d81-428b-a8c3-6b6ff0f404fd of volume 6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] snapshot_file for this snap is: volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a0f06-45c4-480e-8002-b2640ad80357]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:51 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:51 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:52 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.466s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a1284aa-fb9c-44fd-9380-985af4970e8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e55cb-ca5d-40f6-87ad-6d8c294f42eb]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:52 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:52 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:52 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:52 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:52 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:53 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.446s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:53 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd Apr 15 00:22:53 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:53 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a.6572f793-7d81-428b-a8c3-6b6ff0f404fd" returned: 0 in 0.403s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6572f793-7d81-428b-a8c3-6b6ff0f404fd" released by "_delete_snapshot" :: held 1.827s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" released by "delete_snapshot" :: held 1.843s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Created reservations ['dce2d5f7-1cab-40b7-bb6a-9dcad8f0cb61', '827cbab6-27b0-4d91-9e32-13842bf9c0a3', '333a529c-e5bf-4f43-9339-af2febb7132d', '96e1c20c-9874-4c8d-ab10-4564bbcc94b0'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:53 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Delete snapshot completed successfully. Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a028c1bb-5d16-4c56-93f1-e200834df9d0 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-6572f793-7d81-428b-a8c3-6b6ff0f404fd-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-6a1284aa-fb9c-44fd-9380-985af4970e8a-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-6a1284aa-fb9c-44fd-9380-985af4970e8a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b73f06-72c5-4206-a0c4-8c613889eef6]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:54 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:54 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:54 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.461s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:54 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a Apr 15 00:22:54 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:54 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a1284aa-fb9c-44fd-9380-985af4970e8a" returned: 0 in 0.408s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-6a1284aa-fb9c-44fd-9380-985af4970e8a" released by "delete_volume" :: held 0.902s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:54 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Created reservations ['79b8611d-f1e9-4eeb-a576-d0c8334dacc3', 'd1e2eec3-18f2-46a6-946e-43b8a20181e0', '9380c3e6-9930-4c4d-a8df-cbf854d7573f', '3348ce72-1480-49f3-a924-ade5394dfcd9'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:55 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:55 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-b4bc0026-edb2-4832-84b5-209d261bc05f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-b4bc0026-edb2-4832-84b5-209d261bc05f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" acquired by "delete_volume" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8802a50-de87-41fa-92d5-6f32d6301476]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:55 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f Apr 15 00:22:55 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:55 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.424s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:55 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Deleted volume successfully. Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f0a55f34-3de0-4570-81a0-91cb4443f625 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-6a1284aa-fb9c-44fd-9380-985af4970e8a-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:55 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:55 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f Apr 15 00:22:55 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:56 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b4bc0026-edb2-4832-84b5-209d261bc05f" returned: 0 in 0.411s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-quobyte-b4bc0026-edb2-4832-84b5-209d261bc05f" released by "delete_volume" :: held 0.895s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Created reservations ['65b6fc3e-e196-42c3-8d08-4105fe7b532c', 'f38f2cdd-828b-4ac4-b90a-f65c050b46a3', '9c29afd4-85a7-4ae5-8100-101f662a55b8', '7792f1f7-7b0a-43f6-83c5-bb646aff181b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:22:56 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:22:56 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:22:56 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.429s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:22:56 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Deleted volume successfully. Apr 15 00:22:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5a4e6d45-2648-4896-bcc8-f6d3cddfb339 tempest-SnapshotDependencyTests-1672721195 None] Lock "cinder-b4bc0026-edb2-4832-84b5-209d261bc05f-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:06 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:23:06 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:DELETE=3,cinder:INSERT=9 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (e31f4245-c2e3-406e-982c-901a0eac66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c703642d-5b1b-4531-b88b-6cb5902d9480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c703642d-5b1b-4531-b88b-6cb5902d9480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-51546890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463b2469-ac49-43fc-a98c-236f8347f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c778af-dbae-40af-8d9b-c3d007d81c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c778af-dbae-40af-8d9b-c3d007d81c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc679b3-d5c9-4f97-b118-def4ed460a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc679b3-d5c9-4f97-b118-def4ed460a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463b2469-ac49-43fc-a98c-236f8347f9d6', 'volume_name': 'volume-463b2469-ac49-43fc-a98c-236f8347f9d6', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1240f4fc-0156-45ae-97ab-03fa52a22da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1240f4fc-0156-45ae-97ab-03fa52a22da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b88c87-f5e7-4cbe-bc64-cc43b12cff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Volume 463b2469-ac49-43fc-a98c-236f8347f9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463b2469-ac49-43fc-a98c-236f8347f9d6', 'volume_size': 1} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-51546890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463b2469-ac49-43fc-a98c-236f8347f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Creating volume 463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:08 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:08 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 1073741824 Apr 15 00:23:08 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (63a7ec0b-9bf1-4cce-a818-f5abde9b0ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2863a-6635-4ab1-9b06-134536f0c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2863a-6635-4ab1-9b06-134536f0c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731876677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8b917d-42db-4a1e-96e4-db237f9bfab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8b2272-2512-47cc-a824-da2fedb313fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8b2272-2512-47cc-a824-da2fedb313fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b97f86-3ffd-431b-872e-d8a9713f94ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b97f86-3ffd-431b-872e-d8a9713f94ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8b917d-42db-4a1e-96e4-db237f9bfab2', 'volume_name': 'volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5b17c-de24-4fa3-be9f-c266a0fba7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd5b17c-de24-4fa3-be9f-c266a0fba7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6675749c-7c55-40a2-a51c-5930518d9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume 0d8b917d-42db-4a1e-96e4-db237f9bfab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2', 'volume_size': 1} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (1c9ad2b0-1d09-446f-8efb-624c580848f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb0a94-ee1f-42c8-b4f4-da6c6e28277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb0a94-ee1f-42c8-b4f4-da6c6e28277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706616681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede07a8f-8a23-4ac5-b392-89b8c8b3300e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18985607-cd36-48f7-9f6c-deba404e2987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18985607-cd36-48f7-9f6c-deba404e2987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f99eb-5805-48b4-b3d9-e02cc523d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:08 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7f99eb-5805-48b4-b3d9-e02cc523d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede07a8f-8a23-4ac5-b392-89b8c8b3300e', 'volume_name': 'volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c25f079-9954-44de-8dc8-e452d2f852a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c25f079-9954-44de-8dc8-e452d2f852a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f08dff-93d0-4b55-8498-4100d6227090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Volume ede07a8f-8a23-4ac5-b392-89b8c8b3300e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e', 'volume_size': 1} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (a396f958-f8f7-47c2-9b1d-5e4ca6cd4c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582a1a03-3c32-47dd-bea8-597d6cfcf904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (582a1a03-3c32-47dd-bea8-597d6cfcf904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115625838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e72493-2756-4274-a4e8-0e808ee263f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c00a6-3baf-4d32-9b18-785e440faa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c00a6-3baf-4d32-9b18-785e440faa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f16210-5a68-4f3b-8624-a2eca2d5a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f16210-5a68-4f3b-8624-a2eca2d5a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e72493-2756-4274-a4e8-0e808ee263f3', 'volume_name': 'volume-01e72493-2756-4274-a4e8-0e808ee263f3', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794e85f-3674-4312-a71b-b902905aec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9794e85f-3674-4312-a71b-b902905aec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb898d70-c19c-4709-b104-bcba681cf4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Volume 01e72493-2756-4274-a4e8-0e808ee263f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e72493-2756-4274-a4e8-0e808ee263f3', 'volume_size': 1} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (0d0edbfe-db75-4b65-a17c-5f4a2ea7eda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffbe18d-21c6-46cd-a087-2b910dddb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cffbe18d-21c6-46cd-a087-2b910dddb015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356069083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caa2f6d-339c-405c-ba2b-47539116678c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfdaf1d-0608-4f81-8628-97cec3d10e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfdaf1d-0608-4f81-8628-97cec3d10e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99653a29-a452-47a5-9d13-37b3dd75d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99653a29-a452-47a5-9d13-37b3dd75d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6caa2f6d-339c-405c-ba2b-47539116678c', 'volume_name': 'volume-6caa2f6d-339c-405c-ba2b-47539116678c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf061205-8f78-4163-8347-180da28c0e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf061205-8f78-4163-8347-180da28c0e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e1a75-5fd4-431a-8543-7170a5c36c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Volume 6caa2f6d-339c-405c-ba2b-47539116678c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6caa2f6d-339c-405c-ba2b-47539116678c', 'volume_size': 1} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 1073741824" returned: 0 in 0.703s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:09 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:09 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (ff7dca9c-689d-4345-adfd-dd80a520d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c3464-8644-4b9f-a481-97e9a95f079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9c3464-8644-4b9f-a481-97e9a95f079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24734984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a34901b-d888-42e0-88e3-00b444836582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:10Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2f89c-6fd5-4d1b-9fd8-edf52ff65459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2f89c-6fd5-4d1b-9fd8-edf52ff65459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495ad59-89f8-4f82-bbf4-dafeacf634fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a495ad59-89f8-4f82-bbf4-dafeacf634fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a34901b-d888-42e0-88e3-00b444836582', 'volume_name': 'volume-6a34901b-d888-42e0-88e3-00b444836582', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c0e40-4f83-42dc-a667-232ad8d46d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613c0e40-4f83-42dc-a667-232ad8d46d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211aeb68-b7c4-4ce3-8541-16e1b158e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Volume 6a34901b-d888-42e0-88e3-00b444836582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a34901b-d888-42e0-88e3-00b444836582', 'volume_size': 1} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (db73456a-2d2f-4de9-aab6-05826b4a9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d784625-2d46-4de0-accb-7e7fc95e68b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d784625-2d46-4de0-accb-7e7fc95e68b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1402269592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fdd90c-dced-4494-9322-4d1e6159f5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:10Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e892f2a-fcb5-4b69-8da4-bc90570fd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e892f2a-fcb5-4b69-8da4-bc90570fd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79474e3b-bb62-4cab-9626-4de195bf8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79474e3b-bb62-4cab-9626-4de195bf8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fdd90c-dced-4494-9322-4d1e6159f5d0', 'volume_name': 'volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b985f8-91e9-4fa7-807b-1ac3581cba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b985f8-91e9-4fa7-807b-1ac3581cba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c491b5-149e-46a3-8589-5016df11c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:09 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Volume a5fdd90c-dced-4494-9322-4d1e6159f5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0', 'volume_size': 1} Apr 15 00:23:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:10 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.545s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731876677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8b917d-42db-4a1e-96e4-db237f9bfab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume 0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:10 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b88c87-f5e7-4cbe-bc64-cc43b12cff5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463b2469-ac49-43fc-a98c-236f8347f9d6', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e47c60-f8d9-47cb-a554-237da9bfb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:10 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 1073741824 Apr 15 00:23:10 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:10 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Volume volume-463b2469-ac49-43fc-a98c-236f8347f9d6 (463b2469-ac49-43fc-a98c-236f8347f9d6): created successfully Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e47c60-f8d9-47cb-a554-237da9bfb50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (e31f4245-c2e3-406e-982c-901a0eac66a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-38c1d0ee-4228-4bab-9d34-2755d1d31a17 tempest-VolumeDependencyTests-1166042715 None] Created volume successfully. Apr 15 00:23:10 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 1073741824" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:10 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 Apr 15 00:23:10 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:11 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2" returned: 0 in 0.542s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706616681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede07a8f-8a23-4ac5-b392-89b8c8b3300e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Creating volume ede07a8f-8a23-4ac5-b392-89b8c8b3300e {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:11 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6675749c-7c55-40a2-a51c-5930518d9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134db586-80ea-4747-bb53-480f5a051741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:11 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e 1073741824 Apr 15 00:23:11 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:11 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 (0d8b917d-42db-4a1e-96e4-db237f9bfab2): created successfully Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134db586-80ea-4747-bb53-480f5a051741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (63a7ec0b-9bf1-4cce-a818-f5abde9b0ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:11 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a1873e18-3614-4d00-9ec5-f8c0a74702d6 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:11 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e 1073741824" returned: 0 in 0.543s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:11 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:11 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e Apr 15 00:23:11 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:12 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115625838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e72493-2756-4274-a4e8-0e808ee263f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Creating volume 01e72493-2756-4274-a4e8-0e808ee263f3 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:12 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f08dff-93d0-4b55-8498-4100d6227090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:12 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 1073741824 Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b73f6c6-3a7e-49cd-b51d-9390f668f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:12 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:12 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Volume volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e (ede07a8f-8a23-4ac5-b392-89b8c8b3300e): created successfully Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b73f6c6-3a7e-49cd-b51d-9390f668f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (1c9ad2b0-1d09-446f-8efb-624c580848f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:12 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1b2ee1b0-6287-4046-a829-2b7ab5d3d894 tempest-CreateVolumesFromImageTest-1213430694 None] Created volume successfully. Apr 15 00:23:12 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 1073741824" returned: 0 in 0.573s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:12 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:12 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 Apr 15 00:23:12 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:13 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3" returned: 0 in 0.574s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.915s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356069083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caa2f6d-339c-405c-ba2b-47539116678c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:09Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Creating volume 6caa2f6d-339c-405c-ba2b-47539116678c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:13 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:13 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c 1073741824 Apr 15 00:23:13 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb898d70-c19c-4709-b104-bcba681cf4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e72493-2756-4274-a4e8-0e808ee263f3', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aba3d8e-83dd-47de-bd82-ee042bfa9cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:13 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Volume volume-01e72493-2756-4274-a4e8-0e808ee263f3 (01e72493-2756-4274-a4e8-0e808ee263f3): created successfully Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aba3d8e-83dd-47de-bd82-ee042bfa9cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (a396f958-f8f7-47c2-9b1d-5e4ca6cd4c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:13 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-82931b72-0b92-4e6a-97b5-aac705b91f3f tempest-CreateVolumesFromImageTest-1213430694 None] Created volume successfully. Apr 15 00:23:13 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c 1073741824" returned: 0 in 0.534s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:13 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:13 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c Apr 15 00:23:13 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:14 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c" returned: 0 in 0.526s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.815s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-24734984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a34901b-d888-42e0-88e3-00b444836582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:10Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Creating volume 6a34901b-d888-42e0-88e3-00b444836582 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:14 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c64e1a75-5fd4-431a-8543-7170a5c36c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6caa2f6d-339c-405c-ba2b-47539116678c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26deb2e-18bd-4470-9c57-1cebbcd7654e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:14 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 1073741824 Apr 15 00:23:14 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:14 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Volume volume-6caa2f6d-339c-405c-ba2b-47539116678c (6caa2f6d-339c-405c-ba2b-47539116678c): created successfully Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26deb2e-18bd-4470-9c57-1cebbcd7654e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:14 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (0d0edbfe-db75-4b65-a17c-5f4a2ea7eda1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:14 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-257300c9-feff-441f-af87-b71dbbb67b90 tempest-CreateVolumesFromImageTest-1213430694 None] Created volume successfully. Apr 15 00:23:15 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 1073741824" returned: 0 in 0.578s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:15 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 Apr 15 00:23:15 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:15 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582" returned: 0 in 0.516s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.695s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1402269592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fdd90c-dced-4494-9322-4d1e6159f5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7239aebfb9ff402c8e0da024c3303cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:10Z,use_quota=True,user_id='6adda43159e04f6eaaf71ecb701b6264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Creating volume a5fdd90c-dced-4494-9322-4d1e6159f5d0 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:15 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211aeb68-b7c4-4ce3-8541-16e1b158e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a34901b-d888-42e0-88e3-00b444836582', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:15 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 1073741824 Apr 15 00:23:15 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66559814-a0e2-49fb-8dbd-350b1bea934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:15 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Volume volume-6a34901b-d888-42e0-88e3-00b444836582 (6a34901b-d888-42e0-88e3-00b444836582): created successfully Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66559814-a0e2-49fb-8dbd-350b1bea934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:15 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (ff7dca9c-689d-4345-adfd-dd80a520d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:15 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-61f01217-832b-4f1d-91f6-b65848946491 tempest-CreateVolumesFromImageTest-1213430694 None] Created volume successfully. Apr 15 00:23:16 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 1073741824" returned: 0 in 0.539s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:16 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 Apr 15 00:23:16 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:16 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0" returned: 0 in 0.439s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.645s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90c491b5-149e-46a3-8589-5016df11c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91eef927-1924-482c-91f7-1f23c99bc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Creating offline snapshot aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 of volume 463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:23:16 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Volume volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 (a5fdd90c-dced-4494-9322-4d1e6159f5d0): created successfully Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91eef927-1924-482c-91f7-1f23c99bc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Flow 'volume_create_manager' (db73456a-2d2f-4de9-aab6-05826b4a9d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5f51f-4dd3-455a-ab82-16befc5ebee8]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:16 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:16 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bfbf8520-28f9-412b-932d-5ad36899a765 tempest-CreateVolumesFromImageTest-1213430694 None] Created volume successfully. Apr 15 00:23:16 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:16 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:17 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.527s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:17 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 1G Apr 15 00:23:17 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-a5fdd90c-dced-4494-9322-4d1e6159f5d0-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-a5fdd90c-dced-4494-9322-4d1e6159f5d0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-quobyte-a5fdd90c-dced-4494-9322-4d1e6159f5d0" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-a5fdd90c-dced-4494-9322-4d1e6159f5d0" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5da523-543f-424f-9c54-daef9b13f07d]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:17 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 Apr 15 00:23:17 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:17 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 1G" returned: 0 in 0.607s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:17 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463b2469-ac49-43fc-a98c-236f8347f9d6 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:17 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463b2469-ac49-43fc-a98c-236f8347f9d6 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:17 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:18 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0" returned: 0 in 0.621s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:18 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-463b2469-ac49-43fc-a98c-236f8347f9d6 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.506s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:18 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 is being set with open permissions: ugo+rw Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:18 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0 Apr 15 00:23:18 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:18 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:18 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:18 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:18 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-a5fdd90c-dced-4494-9322-4d1e6159f5d0" returned: 0 in 0.532s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-a5fdd90c-dced-4494-9322-4d1e6159f5d0" released by "delete_volume" :: held 1.176s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:18 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info Apr 15 00:23:18 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Created reservations ['571d832f-782f-4dab-807e-3f5ae7cf25c5', '38ac37b3-0eec-46ff-8f3b-7d01f477096e', 'ba7b1aa4-09fb-435e-87c9-989ba5b8e789', '4c00dbda-fd72-493c-af5e-5c657c917e8e'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:18 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:18 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:18 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:19 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:19 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info is being set with open permissions: ugo+rw Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:19 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info Apr 15 00:23:19 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:19 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.531s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:19 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Deleted volume successfully. Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-891cc678-0596-4d0f-9909-0cc9fcddc91f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-a5fdd90c-dced-4494-9322-4d1e6159f5d0-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-6a34901b-d888-42e0-88e3-00b444836582-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-6a34901b-d888-42e0-88e3-00b444836582-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-quobyte-6a34901b-d888-42e0-88e3-00b444836582" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:19 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.info" returned: 0 in 0.591s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.298s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.891s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:19 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b345aa51-aac3-4349-a517-7c8c3c9e2658 tempest-VolumeDependencyTests-1166042715 None] Create snapshot completed successfully Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-6a34901b-d888-42e0-88e3-00b444836582" acquired by "delete_volume" :: waited 0.059s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating offline snapshot 1a7c9961-7db8-4e50-be50-452512b48c1b of volume 0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac0a4c4-dd03-4102-a98a-dc64bc00fc23]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0478bb-33c6-45a9-aa51-747b2cc51191]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:19 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:20 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 Apr 15 00:23:20 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:20 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 Apr 15 00:23:20 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:20 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:20 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582 Apr 15 00:23:20 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:20 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2" returned: 0 in 0.627s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:20 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b 1G Apr 15 00:23:20 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (29add1e7-879b-418d-8343-058150cb7c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a4165-3c2b-49f3-bdc7-c710d7500015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8a4165-3c2b-49f3-bdc7-c710d7500015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113090448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aadd726c-7c8d-4d98-bedd-1f9fa5a79a91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:21Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd8061a-2bc1-4936-a21f-4cfd1ee76ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd8061a-2bc1-4936-a21f-4cfd1ee76ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5798b268-c39c-4344-9289-16fc3316c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5798b268-c39c-4344-9289-16fc3316c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482', 'volume_name': 'volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482', 'volume_size': 1, 'snapshot_id': 'aadd726c-7c8d-4d98-bedd-1f9fa5a79a91'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a91c8f-c4ef-419c-8d32-7a9689269f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a91c8f-c4ef-419c-8d32-7a9689269f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237b193f-776d-4fcc-baaf-561b1a8a37f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:20 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Volume 9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482', 'volume_size': 1, 'snapshot_id': 'aadd726c-7c8d-4d98-bedd-1f9fa5a79a91'} Apr 15 00:23:20 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:21 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b 1G" returned: 0 in 0.612s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:21 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6a34901b-d888-42e0-88e3-00b444836582" returned: 0 in 0.758s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-6a34901b-d888-42e0-88e3-00b444836582" released by "delete_volume" :: held 1.301s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:21 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b Apr 15 00:23:21 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Created reservations ['9a7ae036-1db4-4938-a6e1-bd284c4280e9', '93c12ebd-d239-41d1-afd6-c2e2b9d1f7bb', '5bbba730-5411-4ab8-9132-fc64e4d427e7', '0ac292d4-f44e-4682-8f3b-52da8532c063'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:21 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:21 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Flow 'volume_create_manager' (0fc9bd98-60c9-48e1-96e4-afcb773b9af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7f6f2f-da96-4231-a2db-9add078cfa9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7f6f2f-da96-4231-a2db-9add078cfa9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1842514493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1002b19b1d8c44cc8b25407b6d6997c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:22Z,use_quota=True,user_id='17810d80fedc49228c34b201a5347516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ae8c4-d951-47ed-a15f-7818351ca849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ae8c4-d951-47ed-a15f-7818351ca849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b8714-47f2-4e02-8fa8-9275dadbad26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288b8714-47f2-4e02-8fa8-9275dadbad26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97', 'volume_name': 'volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8b38ca-b76b-4ce0-944f-bcb3d8b65a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8b38ca-b76b-4ce0-944f-bcb3d8b65a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70981aa-6d39-42bb-8c44-de3f1ade7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:21 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Volume c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97', 'volume_size': 1} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:21 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:21 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b is being set with open permissions: ugo+rw Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:21 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b Apr 15 00:23:21 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:21 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:21 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Deleted volume successfully. Apr 15 00:23:21 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8d32d8be-19d4-43f2-88b5-0d12c3d35ded tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-6a34901b-d888-42e0-88e3-00b444836582-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-6caa2f6d-339c-405c-ba2b-47539116678c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-6caa2f6d-339c-405c-ba2b-47539116678c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-quobyte-6caa2f6d-339c-405c-ba2b-47539116678c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-6caa2f6d-339c-405c-ba2b-47539116678c" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:22 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b" returned: 0 in 0.426s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e5aa3-b282-41d9-8091-f420b3d3237e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:22 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info Apr 15 00:23:22 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:22 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c Apr 15 00:23:22 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:22 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info" returned: 0 in 0.434s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:22 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info is being set with open permissions: ugo+rw Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:22 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c" returned: 0 in 0.477s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:22 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:22 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info Apr 15 00:23:22 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:22 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c Apr 15 00:23:22 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:23 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.info" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:23 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.231s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-6caa2f6d-339c-405c-ba2b-47539116678c" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:23 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4c1b397c-5dce-40fb-bc8e-57c9b49fd1f3 tempest-CreateVolumesFromSnapshotTest-18303158 None] Create snapshot completed successfully Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Creating volume 9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 from snapshot aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-6caa2f6d-339c-405c-ba2b-47539116678c" released by "delete_volume" :: held 0.984s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] snapshot: aadd726c-7c8d-4d98-bedd-1f9fa5a79a91, volume: 9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d066d937-595e-4a08-9b9b-ee75508de08a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Created reservations ['0e3621b2-4d8e-469c-8e50-7be533785717', 'c4808d46-70de-429f-8b09-501a1d26d3a2', '24dcaf08-ef39-4840-b737-db968e0cf7fc', 'a522765e-4809-4755-9045-dd1c222b7fef'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:23 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:23 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:23 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:23 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:23 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:23 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Deleted volume successfully. Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:23 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (234f81fd-6b9a-42bc-bd91-db74b34d23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee35b2d-6210-4ea2-aa79-a27b3a918646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee35b2d-6210-4ea2-aa79-a27b3a918646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-961399012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fb316-d8db-482b-b6f4-65bb226352d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3126d4ba-5e0c-417f-9f83-ab68934db2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3126d4ba-5e0c-417f-9f83-ab68934db2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eff41f-efee-409b-b6f3-1df82fc0e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68eff41f-efee-409b-b6f3-1df82fc0e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477fb316-d8db-482b-b6f4-65bb226352d0', 'volume_name': 'volume-477fb316-d8db-482b-b6f4-65bb226352d0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e65fbc8-20bf-4b92-89bb-0fccb7064d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e65fbc8-20bf-4b92-89bb-0fccb7064d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b633b682-aa52-4c5b-8244-ef8bcf557b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume 477fb316-d8db-482b-b6f4-65bb226352d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477fb316-d8db-482b-b6f4-65bb226352d0', 'volume_size': 1} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.580s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-463b2469-ac49-43fc-a98c-236f8347f9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-dfabb364-b9c7-4756-b4f7-807240cf8ae0 tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-6caa2f6d-339c-405c-ba2b-47539116678c-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc71e9-884e-41ab-863c-2be432ee0849]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:23 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:23 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (49605db2-c4e1-4925-b67d-ee506f265aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94f60e0-8af4-4070-992a-e084d9daf575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94f60e0-8af4-4070-992a-e084d9daf575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037677869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dad633-75c7-4e68-a492-3d593242d65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b36da80-c931-4093-9e6a-9afbccfd39b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b36da80-c931-4093-9e6a-9afbccfd39b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a551e93-913a-4faf-8141-22856608fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a551e93-913a-4faf-8141-22856608fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03dad633-75c7-4e68-a492-3d593242d65f', 'volume_name': 'volume-03dad633-75c7-4e68-a492-3d593242d65f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f86160a-c50e-4535-a278-1b9339b3a6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f86160a-c50e-4535-a278-1b9339b3a6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95661cd0-f564-40a2-af48-5f10e4e3f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:23 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume 03dad633-75c7-4e68-a492-3d593242d65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03dad633-75c7-4e68-a492-3d593242d65f', 'volume_size': 1} Apr 15 00:23:23 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (e99818c9-5a03-42a0-a1ec-e88141b9abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901f6f66-560c-4ec8-9ccc-8f87b443cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901f6f66-560c-4ec8-9ccc-8f87b443cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650305288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9cb436-3322-436c-b319-a96b7d194a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33273654-fdbb-474f-9dea-2d58914ceca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33273654-fdbb-474f-9dea-2d58914ceca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0228fc-426d-483c-bce4-4749f80479f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0228fc-426d-483c-bce4-4749f80479f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9cb436-3322-436c-b319-a96b7d194a60', 'volume_name': 'volume-7e9cb436-3322-436c-b319-a96b7d194a60', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ccf33d-8ffe-486c-a3e8-4e5e2dc5c617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ccf33d-8ffe-486c-a3e8-4e5e2dc5c617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a1bf94-5c11-432b-b9c1-27f49b411d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume 7e9cb436-3322-436c-b319-a96b7d194a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9cb436-3322-436c-b319-a96b7d194a60', 'volume_size': 1} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (dbf710a9-d9e9-4cb2-b12b-1ef96c6a400e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb2362-f6d9-4e34-a454-a7deee47f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-01e72493-2756-4274-a4e8-0e808ee263f3-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb2362-f6d9-4e34-a454-a7deee47f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629970236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95967d9-7979-4a3f-a9a8-41b5928dff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a736b95-0ca0-4bdb-a84e-a1106dd4d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a736b95-0ca0-4bdb-a84e-a1106dd4d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf308c25-7f79-4394-8ec5-2d9ede9f273f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf308c25-7f79-4394-8ec5-2d9ede9f273f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95967d9-7979-4a3f-a9a8-41b5928dff53', 'volume_name': 'volume-c95967d9-7979-4a3f-a9a8-41b5928dff53', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c6fb3-5596-435d-8f81-682712405777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90c6fb3-5596-435d-8f81-682712405777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19acad-15de-49ca-821e-c17ea98845aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume c95967d9-7979-4a3f-a9a8-41b5928dff53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95967d9-7979-4a3f-a9a8-41b5928dff53', 'volume_size': 1} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-01e72493-2756-4274-a4e8-0e808ee263f3-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:24 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.616s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-quobyte-01e72493-2756-4274-a4e8-0e808ee263f3" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:24 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 Apr 15 00:23:24 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-01e72493-2756-4274-a4e8-0e808ee263f3" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e107dea6-30c3-4ce0-ad4b-3ec052e7c2ef]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (74c5a9ae-67c9-4b23-ad8b-02017c98d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94cbc12-4f8c-4518-839a-3431636a009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 Apr 15 00:23:24 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94cbc12-4f8c-4518-839a-3431636a009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293518587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd5dad-6146-462d-956f-e830c54ac75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debc33da-cee6-47f2-a4fe-2141b180b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debc33da-cee6-47f2-a4fe-2141b180b062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eab1c9e-8021-4b95-956d-0fbdf5368cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eab1c9e-8021-4b95-956d-0fbdf5368cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cd5dad-6146-462d-956f-e830c54ac75f', 'volume_name': 'volume-b7cd5dad-6146-462d-956f-e830c54ac75f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1497924c-2672-4357-9be9-eb19df49618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1497924c-2672-4357-9be9-eb19df49618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d0c0e9-8a68-470d-8449-dc2fb2cdce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:24 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume b7cd5dad-6146-462d-956f-e830c54ac75f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cd5dad-6146-462d-956f-e830c54ac75f', 'volume_size': 1} Apr 15 00:23:24 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:25 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3" returned: 0 in 0.787s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:25 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:25 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3 Apr 15 00:23:25 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:26 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-01e72493-2756-4274-a4e8-0e808ee263f3" returned: 0 in 0.945s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-01e72493-2756-4274-a4e8-0e808ee263f3" released by "delete_volume" :: held 1.771s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Created reservations ['00e9b5e2-15c7-4d1c-a9e3-e11d05033aa2', 'd1b7d587-2615-485b-8246-10af7006121f', '7c94a762-f9f8-4eb7-b780-88d07fd821ad', '5769ce3e-5cbc-4f4c-b1f4-7e339083e554'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:26 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:26 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:26 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" returned: 0 in 2.082s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[d355b0f8-d2da-45da-951e-086d0b9a3cf3]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-ede07a8f-8a23-4ac5-b392-89b8c8b3300e-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-ede07a8f-8a23-4ac5-b392-89b8c8b3300e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "cinder-quobyte-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1279f89-d8e0-491e-8db2-fcd94aef5a7c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:26 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:26 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:26 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e Apr 15 00:23:26 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:26 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:26 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Deleted volume successfully. Apr 15 00:23:26 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-42c80afc-aedb-48c8-8ab9-6dbe89414acc tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-01e72493-2756-4274-a4e8-0e808ee263f3-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:27 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" returned: 0 in 0.501s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:27 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e Apr 15 00:23:27 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:27 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.673s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:23:27 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Converted 1024.00 MB image at 491.52 MB/s Apr 15 00:23:27 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 is being set with open permissions: ugo+rw Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:27 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 Apr 15 00:23:27 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:27 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" returned: 0 in 0.400s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-quobyte-ede07a8f-8a23-4ac5-b392-89b8c8b3300e" released by "delete_volume" :: held 0.931s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Created reservations ['60ff4acb-beca-45fe-b700-5a6b11125869', 'd0474d89-80e9-4887-aa53-a3b0e41f6929', 'e7910dc5-b793-4593-b2b1-64640d5d8126', 'a8f84903-d5c0-4901-b33e-683f4b3cbdf2'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:27 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" returned: 0 in 0.399s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" released by "_copy_volume_from_snapshot" :: held 4.413s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" released by "_create_volume_from_snapshot" :: held 4.431s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.465s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:27 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:27 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.931s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1842514493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1002b19b1d8c44cc8b25407b6d6997c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:22Z,use_quota=True,user_id='17810d80fedc49228c34b201a5347516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Creating volume c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:27 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:27 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 1073741824 Apr 15 00:23:27 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237b193f-776d-4fcc-baaf-561b1a8a37f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482', 'volume_size': 1, 'snapshot_id': 'aadd726c-7c8d-4d98-bedd-1f9fa5a79a91'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f060292-72ad-49b0-bbf3-8bf0546a1bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:27 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Volume volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 (9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482): created successfully Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f060292-72ad-49b0-bbf3-8bf0546a1bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (29add1e7-879b-418d-8343-058150cb7c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:27 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-31928d06-ebfa-448c-96cc-c543a163f916 tempest-VolumeDependencyTests-1166042715 None] Created volume successfully. Apr 15 00:23:27 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:27 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Deleted volume successfully. Apr 15 00:23:27 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c5a53332-0b56-4fca-9801-8f8c2794661f tempest-CreateVolumesFromImageTest-1213430694 None] Lock "cinder-ede07a8f-8a23-4ac5-b392-89b8c8b3300e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Deleting offline snapshot aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 of volume 463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] snapshot_file for this snap is: volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[79acf70e-b42e-4c23-b25b-5ddc43fb5b3c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:28 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 1073741824" returned: 0 in 0.674s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:28 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:28 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:28 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:28 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:28 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.479s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.996s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-961399012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fb316-d8db-482b-b6f4-65bb226352d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume 477fb316-d8db-482b-b6f4-65bb226352d0 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:28 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:28 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.585s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-463b2469-ac49-43fc-a98c-236f8347f9d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:28 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 1073741824 Apr 15 00:23:28 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70981aa-6d39-42bb-8c44-de3f1ade7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29722dc-bca8-46d2-86f0-afc50a3cc73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7f751f-1ddb-4034-be9c-7e166cb68ab1]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:28 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Volume volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 (c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97): created successfully Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29722dc-bca8-46d2-86f0-afc50a3cc73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:28 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Flow 'volume_create_manager' (0fc9bd98-60c9-48e1-96e4-afcb773b9af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:28 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-dc736509-b82e-44db-8352-e63277b13e6e tempest-SnapshotDependencyTests-1002930710 None] Created volume successfully. Apr 15 00:23:28 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:28 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:29 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 1073741824" returned: 0 in 0.632s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:29 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (a46d7a51-d639-4fe0-bafc-cf34da9719ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69476a66-93cf-48ec-bc2c-1213eb1bb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.638s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:29 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 Apr 15 00:23:29 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69476a66-93cf-48ec-bc2c-1213eb1bb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1914772329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeff53d-9982-44f3-bb2d-f57f99cd74d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:29Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc407c8-f77f-473c-b8bf-32d797d1acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc407c8-f77f-473c-b8bf-32d797d1acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc49d09-ac21-4f53-993b-2506fa5726f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc49d09-ac21-4f53-993b-2506fa5726f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edeff53d-9982-44f3-bb2d-f57f99cd74d5', 'volume_name': 'volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447f987-0a67-4afc-9954-6fd2d90778a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d447f987-0a67-4afc-9954-6fd2d90778a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093fa7d-9543-487d-b26f-5aaaf85e2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume edeff53d-9982-44f3-bb2d-f57f99cd74d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5', 'volume_size': 1} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:29 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.932s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037677869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dad633-75c7-4e68-a492-3d593242d65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume 03dad633-75c7-4e68-a492-3d593242d65f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:29 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b633b682-aa52-4c5b-8244-ef8bcf557b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477fb316-d8db-482b-b6f4-65bb226352d0', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f 1073741824 Apr 15 00:23:29 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486855c8-381e-4b16-92dc-1571522ab1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:29 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.476s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:29 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-477fb316-d8db-482b-b6f4-65bb226352d0 (477fb316-d8db-482b-b6f4-65bb226352d0): created successfully Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486855c8-381e-4b16-92dc-1571522ab1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:29 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91 Apr 15 00:23:29 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:29 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (234f81fd-6b9a-42bc-bd91-db74b34d23dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:29 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-6198e024-69a9-47ee-85e8-d4f219562d55 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:30 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6.aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" returned: 0 in 0.450s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:30 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f 1073741824" returned: 0 in 0.502s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91" released by "_delete_snapshot" :: held 2.237s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" released by "delete_snapshot" :: held 2.251s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:30 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f Apr 15 00:23:30 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Created reservations ['fc941f97-5b2e-4b52-9649-f02ee39ebd22', '846e07aa-8fec-44c1-94ee-569f874581c4', '5e20bd29-57f4-40dc-bd8c-25f171519350', '685fb1f1-5ca2-497f-8bbc-8933d79b19db'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:30 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Delete snapshot completed successfully. Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-9a0d5899-294b-4939-84e3-06d7c6bd90b3 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-aadd726c-7c8d-4d98-bedd-1f9fa5a79a91-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:30 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f" returned: 0 in 0.442s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.729s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-650305288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9cb436-3322-436c-b319-a96b7d194a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume 7e9cb436-3322-436c-b319-a96b7d194a60 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:30 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95661cd0-f564-40a2-af48-5f10e4e3f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03dad633-75c7-4e68-a492-3d593242d65f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4687db6-e01b-4e37-a7d5-07b1e2bbbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:30 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 1073741824 Apr 15 00:23:30 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:30 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-03dad633-75c7-4e68-a492-3d593242d65f (03dad633-75c7-4e68-a492-3d593242d65f): created successfully Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4687db6-e01b-4e37-a7d5-07b1e2bbbe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:30 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (49605db2-c4e1-4925-b67d-ee506f265aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:30 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-446fcc12-686a-4796-b246-0cd2ad95e797 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-463b2469-ac49-43fc-a98c-236f8347f9d6-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-463b2469-ac49-43fc-a98c-236f8347f9d6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:31 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 1073741824" returned: 0 in 0.534s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" acquired by "delete_volume" :: waited 0.021s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:31 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 Apr 15 00:23:31 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[813ddca6-347a-407c-9d28-5f00f6af5092]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:31 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:31 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:31 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60" returned: 0 in 0.436s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.555s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-629970236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95967d9-7979-4a3f-a9a8-41b5928dff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume c95967d9-7979-4a3f-a9a8-41b5928dff53 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:31 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:31 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 1073741824 Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a1bf94-5c11-432b-b9c1-27f49b411d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9cb436-3322-436c-b319-a96b7d194a60', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:31 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2eb96d4-93f0-4d1e-9e1c-dd62a9aeba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:31 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-7e9cb436-3322-436c-b319-a96b7d194a60 (7e9cb436-3322-436c-b319-a96b7d194a60): created successfully Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2eb96d4-93f0-4d1e-9e1c-dd62a9aeba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (e99818c9-5a03-42a0-a1ec-e88141b9abad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:31 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-49ce1257-ba0e-458d-8781-861137db30b4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:31 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.492s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:31 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:32 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6 Apr 15 00:23:32 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:32 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 1073741824" returned: 0 in 0.493s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:32 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-463b2469-ac49-43fc-a98c-236f8347f9d6" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-463b2469-ac49-43fc-a98c-236f8347f9d6" released by "delete_volume" :: held 0.969s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:32 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 Apr 15 00:23:32 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Created reservations ['8ac473a9-b1e0-40da-b30c-60d4507900a2', '47173f71-6b37-4454-9d43-673de8a94d37', 'fad219bd-d156-487d-bfc7-6d1a92c96315', '423f686c-43f4-407a-9ee1-76c2a2f089a0'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:32 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:32 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:32 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53" returned: 0 in 0.458s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.376s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293518587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd5dad-6146-462d-956f-e830c54ac75f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00f908d32cf7455bae6821d46b80fcc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:24Z,use_quota=True,user_id='42ff793af2a848e4b250a65faacc1658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Creating volume b7cd5dad-6146-462d-956f-e830c54ac75f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:32 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c19acad-15de-49ca-821e-c17ea98845aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95967d9-7979-4a3f-a9a8-41b5928dff53', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a294cea1-6a4a-40e2-a8bf-de76893dfb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:32 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f 1073741824 Apr 15 00:23:32 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:32 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:32 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 (c95967d9-7979-4a3f-a9a8-41b5928dff53): created successfully Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a294cea1-6a4a-40e2-a8bf-de76893dfb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (dbf710a9-d9e9-4cb2-b12b-1ef96c6a400e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:32 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Deleted volume successfully. Apr 15 00:23:32 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-39b12aaf-d45e-4791-9c54-14f6d169cdcf tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:32 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7d824c1e-b289-4850-9b15-44587802981e tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-463b2469-ac49-43fc-a98c-236f8347f9d6-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:33 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f 1073741824" returned: 0 in 0.511s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:33 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f Apr 15 00:23:33 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (413417ae-8ed2-4a6e-b9e7-82787b042dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afff8a91-096f-4ed7-97fc-a9f1ba735510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afff8a91-096f-4ed7-97fc-a9f1ba735510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1638013639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad845faa-a8bc-497f-b477-e436eb286f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:34Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff759c1-598e-40ba-8014-5d94cc8c913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff759c1-598e-40ba-8014-5d94cc8c913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2700aac4-b51d-4369-93a3-b8111c21776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2700aac4-b51d-4369-93a3-b8111c21776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad845faa-a8bc-497f-b477-e436eb286f52', 'volume_name': 'volume-ad845faa-a8bc-497f-b477-e436eb286f52', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eda57e-3f87-465a-8ec9-e1d59002e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1eda57e-3f87-465a-8ec9-e1d59002e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc1c770-6fc6-4163-891a-f5142e3f5d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Volume ad845faa-a8bc-497f-b477-e436eb286f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad845faa-a8bc-497f-b477-e436eb286f52', 'volume_size': 1} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:33 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f" returned: 0 in 0.458s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.631s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d0c0e9-8a68-470d-8449-dc2fb2cdce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cd5dad-6146-462d-956f-e830c54ac75f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547063a4-3ee6-422b-b777-a3a6d597045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Creating offline snapshot 53d13eaa-7de8-4c08-aaa3-85c469abeac7 of volume c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:23:33 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Volume volume-b7cd5dad-6146-462d-956f-e830c54ac75f (b7cd5dad-6146-462d-956f-e830c54ac75f): created successfully Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547063a4-3ee6-422b-b777-a3a6d597045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Flow 'volume_create_manager' (74c5a9ae-67c9-4b23-ad8b-02017c98d598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[2871a94c-bbeb-49ab-91bf-98754362bae5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:33 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:33 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-eeb8b97d-f430-4cc4-b71b-26ee2771057c tempest-CreateVolumesFromSnapshotTest-18303158 None] Created volume successfully. Apr 15 00:23:34 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:34 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-b7cd5dad-6146-462d-956f-e830c54ac75f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-b7cd5dad-6146-462d-956f-e830c54ac75f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-b7cd5dad-6146-462d-956f-e830c54ac75f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-b7cd5dad-6146-462d-956f-e830c54ac75f" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea8e4bd-75fd-4ee6-aebe-79d4719b9d7f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:34 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f Apr 15 00:23:34 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:34 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.502s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:34 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 1G Apr 15 00:23:34 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:34 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:34 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f Apr 15 00:23:34 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:34 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 1G" returned: 0 in 0.490s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:34 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:34 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:34 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:35 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-b7cd5dad-6146-462d-956f-e830c54ac75f" returned: 0 in 0.430s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-b7cd5dad-6146-462d-956f-e830c54ac75f" released by "delete_volume" :: held 0.956s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['cebf8476-0bf3-445a-8422-46888c3246e7', '6e91abf4-57a2-491e-bba0-46f7abcea3ea', 'd2d88a1f-aaf9-4670-91ad-ec6bba267502', '29b168d5-7691-4934-a6af-9332414259ae'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:35 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:35 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-c95967d9-7979-4a3f-a9a8-41b5928dff53-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-c95967d9-7979-4a3f-a9a8-41b5928dff53-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-c95967d9-7979-4a3f-a9a8-41b5928dff53" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-c95967d9-7979-4a3f-a9a8-41b5928dff53" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:35 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.472s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:35 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 is being set with open permissions: ugo+rw Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f564df-2468-4e64-b510-a212f9d6a29c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:35 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:35 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:35 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 Apr 15 00:23:35 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:35 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:35 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1f1d1ca4-cb72-4413-a6dd-cf11551413e1 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-b7cd5dad-6146-462d-956f-e830c54ac75f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.433s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:35 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:35 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info Apr 15 00:23:35 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:35 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53" returned: 0 in 0.500s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:35 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:35 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53 Apr 15 00:23:35 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:36 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info" returned: 0 in 0.415s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:36 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info is being set with open permissions: ugo+rw Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:36 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info Apr 15 00:23:36 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:36 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c95967d9-7979-4a3f-a9a8-41b5928dff53" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-c95967d9-7979-4a3f-a9a8-41b5928dff53" released by "delete_volume" :: held 0.980s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['c61efbce-d653-4e0e-a207-472a69b9dc10', 'ecb16259-8956-4ab6-8024-f60d4c5da0c6', '07b2dc63-55cd-4f07-9bed-9c3e2742f3a5', 'aa8dc5fb-03b1-4f6a-bf31-0a4d73f2fece'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:36 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:36 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-7e9cb436-3322-436c-b319-a96b7d194a60-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-7e9cb436-3322-436c-b319-a96b7d194a60-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-7e9cb436-3322-436c-b319-a96b7d194a60" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-7e9cb436-3322-436c-b319-a96b7d194a60" acquired by "delete_volume" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a65ce8a-cc41-488f-b241-5fd9f2c38690]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:36 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 Apr 15 00:23:36 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:36 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.info" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.253s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1914772329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edeff53d-9982-44f3-bb2d-f57f99cd74d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:29Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume edeff53d-9982-44f3-bb2d-f57f99cd74d5 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:36 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:36 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 1073741824 Apr 15 00:23:36 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-17676549-892a-4376-af7b-b055152cb238 tempest-SnapshotDependencyTests-1002930710 None] Create snapshot completed successfully Apr 15 00:23:36 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:36 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:36 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7b2c7b05-480a-477b-bb63-acd29d56dbd5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-c95967d9-7979-4a3f-a9a8-41b5928dff53-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:37 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:37 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60 Apr 15 00:23:37 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:37 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 1073741824" returned: 0 in 0.503s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:37 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 Apr 15 00:23:37 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:37 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-7e9cb436-3322-436c-b319-a96b7d194a60" returned: 0 in 0.485s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-7e9cb436-3322-436c-b319-a96b7d194a60" released by "delete_volume" :: held 1.062s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['eb000f8e-dfa9-415f-b576-459dd5d9ee66', '1dee408b-dd21-4977-bb22-02642adb2d05', '4bd2bcb8-fde1-4f4c-9a45-c0c9abcefddc', '88ab88c6-85f1-403e-b6d3-af9e57bc5334'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:37 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:37 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:37 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5" returned: 0 in 0.427s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1638013639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad845faa-a8bc-497f-b477-e436eb286f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:34Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Creating volume ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:37 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f093fa7d-9543-487d-b26f-5aaaf85e2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6592de54-a80b-4478-8bfe-d9fec103d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 1073741824 Apr 15 00:23:37 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 (edeff53d-9982-44f3-bb2d-f57f99cd74d5): created successfully Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6592de54-a80b-4478-8bfe-d9fec103d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (a46d7a51-d639-4fe0-bafc-cf34da9719ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:37 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-bfc8bc47-7875-4e1c-9686-4f650294d81c tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Flow 'volume_create_manager' (725fbbb2-b679-4412-83a1-994ead510507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c9dd21-26c8-41ff-987d-0134cb4ce2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c9dd21-26c8-41ff-987d-0134cb4ce2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f643eca3-0be6-43a0-9400-2d5fb0fe2a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1002b19b1d8c44cc8b25407b6d6997c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53d13eaa-7de8-4c08-aaa3-85c469abeac7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:38Z,use_quota=True,user_id='17810d80fedc49228c34b201a5347516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d3592-2905-438f-9440-431cdc59337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d3592-2905-438f-9440-431cdc59337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8e6e5c-5f0d-4822-b7d9-513824760fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8e6e5c-5f0d-4822-b7d9-513824760fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f643eca3-0be6-43a0-9400-2d5fb0fe2a73', 'volume_name': 'volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73', 'volume_size': 1, 'snapshot_id': '53d13eaa-7de8-4c08-aaa3-85c469abeac7'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8937585-14da-414a-89c6-885da876257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8937585-14da-414a-89c6-885da876257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd12835-b883-48ee-8c20-10d456b47c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:37 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Volume f643eca3-0be6-43a0-9400-2d5fb0fe2a73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73', 'volume_size': 1, 'snapshot_id': '53d13eaa-7de8-4c08-aaa3-85c469abeac7'} Apr 15 00:23:37 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.500s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5577f854-a983-4630-aa6a-932193ae23c5 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-7e9cb436-3322-436c-b319-a96b7d194a60-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (fdb65d87-80ac-4a43-b37c-1e4f174eea3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90094b14-4951-491c-8c1d-cd90fecc3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90094b14-4951-491c-8c1d-cd90fecc3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-263745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249b13fb-24a8-4dc0-8c11-b87bf3814c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:38Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc99f10-edc0-49b6-a4c9-d9390c4da1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc99f10-edc0-49b6-a4c9-d9390c4da1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9a91b0-8dbb-46b2-b1e0-7edffab981d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9a91b0-8dbb-46b2-b1e0-7edffab981d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249b13fb-24a8-4dc0-8c11-b87bf3814c78', 'volume_name': 'volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4345fe53-faec-41e3-becf-a158fce19ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4345fe53-faec-41e3-becf-a158fce19ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4195c117-a80c-45a4-a322-4f8e025ebf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume 249b13fb-24a8-4dc0-8c11-b87bf3814c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78', 'volume_size': 1} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 1073741824" returned: 0 in 0.610s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:38 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:38 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (722e2b39-b81d-487d-ab0a-aed2773d277d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a58258-83c4-4d05-8d14-cc6a12e75e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a58258-83c4-4d05-8d14-cc6a12e75e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781782636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1179705b-981e-44ea-a2b1-47aee418e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:38Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea5de42-c5a9-40d3-b3b0-c2bcb42c67e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea5de42-c5a9-40d3-b3b0-c2bcb42c67e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4f1494-1332-43cd-9940-240cfffeec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef4f1494-1332-43cd-9940-240cfffeec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1179705b-981e-44ea-a2b1-47aee418e4a8', 'volume_name': 'volume-1179705b-981e-44ea-a2b1-47aee418e4a8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e9b63c-67ed-45fd-95dd-892883de54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e9b63c-67ed-45fd-95dd-892883de54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97151e3-4f63-48cc-9631-48cbca3c2133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume 1179705b-981e-44ea-a2b1-47aee418e4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1179705b-981e-44ea-a2b1-47aee418e4a8', 'volume_size': 1} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (01532549-c836-42fb-b992-fef473c56654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3fbbd-042d-428e-b3c8-3ae4bf20053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c3fbbd-042d-428e-b3c8-3ae4bf20053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825114691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82622b1e-16d2-4de4-9535-f228da3f431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d47c58-23dc-461b-9695-61b8a59efad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d47c58-23dc-461b-9695-61b8a59efad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3def42-b5af-439a-b681-fd70f0a8b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3def42-b5af-439a-b681-fd70f0a8b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82622b1e-16d2-4de4-9535-f228da3f431f', 'volume_name': 'volume-82622b1e-16d2-4de4-9535-f228da3f431f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0637b0-408d-4755-839f-8680c6f35837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af0637b0-408d-4755-839f-8680c6f35837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c18ab9b-ab57-4146-ae7d-b6aee2bd8a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume 82622b1e-16d2-4de4-9535-f228da3f431f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82622b1e-16d2-4de4-9535-f228da3f431f', 'volume_size': 1} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-03dad633-75c7-4e68-a492-3d593242d65f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-03dad633-75c7-4e68-a492-3d593242d65f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-03dad633-75c7-4e68-a492-3d593242d65f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-03dad633-75c7-4e68-a492-3d593242d65f" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[4199d389-8543-43a7-b452-9503efc15e9f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:38 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f Apr 15 00:23:38 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (e2026b5a-8ece-4924-8747-8b4fd0e00a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6ee9a1-69f0-4e61-b053-a8485b79951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef6ee9a1-69f0-4e61-b053-a8485b79951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238962442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8122a9-a9df-4559-806a-a2a28bd6b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f46eea-373b-4936-b188-c6202e6fbc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f46eea-373b-4936-b188-c6202e6fbc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8404c-0f40-444c-9a02-0b1f09894a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8404c-0f40-444c-9a02-0b1f09894a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c8122a9-a9df-4559-806a-a2a28bd6b38c', 'volume_name': 'volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be0ca51-cd5a-4d88-a51d-c96b75376b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be0ca51-cd5a-4d88-a51d-c96b75376b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac0f9f4-41e0-47d4-9e3d-fa8ba59b7083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume 3c8122a9-a9df-4559-806a-a2a28bd6b38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c', 'volume_size': 1} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.548s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.923s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" by "_create_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Creating volume f643eca3-0be6-43a0-9400-2d5fb0fe2a73 from snapshot 53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc1c770-6fc6-4163-891a-f5142e3f5d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad845faa-a8bc-497f-b477-e436eb286f52', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e193eaa6-1398-4227-a60c-0ccad8be3a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] snapshot: 53d13eaa-7de8-4c08-aaa3-85c469abeac7, volume: f643eca3-0be6-43a0-9400-2d5fb0fe2a73, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Volume volume-ad845faa-a8bc-497f-b477-e436eb286f52 (ad845faa-a8bc-497f-b477-e436eb286f52): created successfully Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e193eaa6-1398-4227-a60c-0ccad8be3a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (413417ae-8ed2-4a6e-b9e7-82787b042dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:38 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-355e667f-9426-4ac9-a96b-74b0fbd405e6 tempest-VolumeDependencyTests-1166042715 None] Created volume successfully. Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fec21d-fbe5-4207-8381-23455b792948]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:38 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (c88fd8e1-949d-40de-a592-96cc0597b63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:39 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:39 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8ab4e6-4bc9-43d5-869b-86fb1aaf5010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e8ab4e6-4bc9-43d5-869b-86fb1aaf5010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527839188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d607f77b-900d-4696-80b2-81f0f656f6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad87bf0-01bc-46cf-971f-665df4835754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad87bf0-01bc-46cf-971f-665df4835754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66293d46-2f75-4886-842d-e45cb51aa935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66293d46-2f75-4886-842d-e45cb51aa935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd607f77b-900d-4696-80b2-81f0f656f6c9', 'volume_name': 'volume-d607f77b-900d-4696-80b2-81f0f656f6c9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba46184-331f-46b7-906f-f29a9890c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ba46184-331f-46b7-906f-f29a9890c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f841a7-870c-4586-9c5a-27124bfcacf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume d607f77b-900d-4696-80b2-81f0f656f6c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d607f77b-900d-4696-80b2-81f0f656f6c9', 'volume_size': 1} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:39 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f" returned: 0 in 0.540s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:39 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f Apr 15 00:23:39 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (6d0ac601-2529-47a5-9cb2-4dc1b1a7abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a878109-5281-4168-a568-5b39462ea1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a878109-5281-4168-a568-5b39462ea1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1564588644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e703e34d-f1db-40fa-828f-b61626ef497b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17989e1dc181494d96df95877a76725a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ad845faa-a8bc-497f-b477-e436eb286f52,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='15b7717c00254acb9de13ee3c059cc95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b0b95b-5e7d-40da-ad26-8e786247e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b0b95b-5e7d-40da-ad26-8e786247e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950dadac-d0a0-40f3-9624-2c56d355e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950dadac-d0a0-40f3-9624-2c56d355e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e703e34d-f1db-40fa-828f-b61626ef497b', 'volume_name': 'volume-e703e34d-f1db-40fa-828f-b61626ef497b', 'volume_size': 1, 'source_volid': 'ad845faa-a8bc-497f-b477-e436eb286f52', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b66cb8-b8f9-4337-8a7b-f0ef65db1c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b66cb8-b8f9-4337-8a7b-f0ef65db1c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947cd937-1a7a-431b-bb71-9d265a1a703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:39 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Volume e703e34d-f1db-40fa-828f-b61626ef497b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e703e34d-f1db-40fa-828f-b61626ef497b', 'volume_size': 1, 'source_volid': 'ad845faa-a8bc-497f-b477-e436eb286f52', 'source_volstatus': 'available'} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:39 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.544s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e305f9-8249-44fc-ad02-e0c38815925b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:39 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:39 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:39 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-03dad633-75c7-4e68-a492-3d593242d65f" returned: 0 in 0.449s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-03dad633-75c7-4e68-a492-3d593242d65f" released by "delete_volume" :: held 1.015s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['1787eedb-9eb6-43c3-8725-41925bc19527', '546c13dc-f419-4b83-969e-d01bd7fd2713', '413ba59a-47a3-42f0-b8e4-a508ee20c9a2', '594a0b51-5084-4656-ab36-a62e487daf26'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:39 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:39 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-477fb316-d8db-482b-b6f4-65bb226352d0-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-477fb316-d8db-482b-b6f4-65bb226352d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-477fb316-d8db-482b-b6f4-65bb226352d0" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-477fb316-d8db-482b-b6f4-65bb226352d0" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c602025a-d3df-4061-8320-6526b2a97a6b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:39 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:39 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 Apr 15 00:23:39 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:40 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.542s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:40 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 Apr 15 00:23:40 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:40 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:40 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-e8444b5e-69c6-4cbf-a7ba-5d6dd0444090 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-03dad633-75c7-4e68-a492-3d593242d65f-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:40 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0" returned: 0 in 0.519s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:40 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:40 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0 Apr 15 00:23:40 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:41 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-477fb316-d8db-482b-b6f4-65bb226352d0" returned: 0 in 1.122s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-477fb316-d8db-482b-b6f4-65bb226352d0" released by "delete_volume" :: held 1.672s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['0db56423-a667-4ce6-a9bd-61517d5906ed', '974376cb-451c-4495-ac6f-780da4057f06', 'b89fd937-5140-46de-8b50-827de36f5a98', 'db062ca0-1803-4e89-bc55-544aca27b5da'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:41 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:41 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:41 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-1a7c9961-7db8-4e50-be50-452512b48c1b-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-1a7c9961-7db8-4e50-be50-452512b48c1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-1a7c9961-7db8-4e50-be50-452512b48c1b" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-1a7c9961-7db8-4e50-be50-452512b48c1b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleting offline snapshot 1a7c9961-7db8-4e50-be50-452512b48c1b of volume 0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] snapshot_file for this snap is: volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b4c992-2c2a-4c74-9fe5-267f308f1a63]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:42 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" returned: 0 in 2.152s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466a193-66ff-4d11-a935-aaf59a6dcb29]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_service.periodic_task [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83219) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:42 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b Apr 15 00:23:42 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:42 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:42 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:42 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:42 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:42 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.706s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:42 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a02d5c74-5772-4961-a497-8db3f43f6495 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-477fb316-d8db-482b-b6f4-65bb226352d0-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:42 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b" returned: 0 in 0.534s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[12522d89-f428-4f13-b8a5-728991e04af5]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:42 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.517s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8ce2256b-c47a-4ed8-aad4-88c973cccbc5 None None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:42 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 Apr 15 00:23:42 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:42 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.734s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:23:42 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Converted 1024.00 MB image at 475.55 MB/s Apr 15 00:23:42 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 is being set with open permissions: ugo+rw Apr 15 00:23:42 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:42 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 Apr 15 00:23:42 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:43 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:43 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b Apr 15 00:23:43 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:43 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" returned: 0 in 0.422s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" released by "_copy_volume_from_snapshot" :: held 4.472s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" released by "_create_volume_from_snapshot" :: held 4.506s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.516s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.124s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-263745643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249b13fb-24a8-4dc0-8c11-b87bf3814c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:38Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume 249b13fb-24a8-4dc0-8c11-b87bf3814c78 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:43 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd12835-b883-48ee-8c20-10d456b47c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73', 'volume_size': 1, 'snapshot_id': '53d13eaa-7de8-4c08-aaa3-85c469abeac7'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913a79a9-87c6-43ca-bd19-d9258232a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:43 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 1073741824 Apr 15 00:23:43 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:43 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Volume volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 (f643eca3-0be6-43a0-9400-2d5fb0fe2a73): created successfully Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913a79a9-87c6-43ca-bd19-d9258232a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Flow 'volume_create_manager' (725fbbb2-b679-4412-83a1-994ead510507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:43 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-89f1779b-4452-4ebd-a7e3-5a9631012288 tempest-SnapshotDependencyTests-1002930710 None] Created volume successfully. Apr 15 00:23:43 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b" returned: 0 in 0.462s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:43 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b Apr 15 00:23:43 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:43 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 1073741824" returned: 0 in 0.512s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:43 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:43 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 Apr 15 00:23:43 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:44 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2.1a7c9961-7db8-4e50-be50-452512b48c1b" returned: 0 in 0.434s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-1a7c9961-7db8-4e50-be50-452512b48c1b" released by "_delete_snapshot" :: held 1.975s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" released by "delete_snapshot" :: held 1.987s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['15e365e4-e6f7-4b85-8d86-bc7ea41988ed', '72040c18-b3cb-47d5-8b79-88a96f18c5b2', 'a507da77-e392-4a45-9044-4d46ebc3b837', 'ba7a4b0a-3746-43c4-ad20-622a6687973c'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:44 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Delete snapshot completed successfully. Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-281bf7be-68d3-4cde-8c82-7da4cd33e87d tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-1a7c9961-7db8-4e50-be50-452512b48c1b-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-53d13eaa-7de8-4c08-aaa3-85c469abeac7-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-53d13eaa-7de8-4c08-aaa3-85c469abeac7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Deleting offline snapshot 53d13eaa-7de8-4c08-aaa3-85c469abeac7 of volume c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] snapshot_file for this snap is: volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a3271-839d-468a-8846-e06cb00dab0a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:44 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.906s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781782636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1179705b-981e-44ea-a2b1-47aee418e4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:38Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume 1179705b-981e-44ea-a2b1-47aee418e4a8 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:44 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:44 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4195c117-a80c-45a4-a322-4f8e025ebf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:44 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6bdb09-f9a9-4d78-9c56-4da2c59c9078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:44 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 1073741824 Apr 15 00:23:44 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:44 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 (249b13fb-24a8-4dc0-8c11-b87bf3814c78): created successfully Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6bdb09-f9a9-4d78-9c56-4da2c59c9078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (fdb65d87-80ac-4a43-b37c-1e4f174eea3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:44 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-e083f7ea-4c1a-4777-b4c0-77962dd50728 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:44 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.498s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c09ea2-bad2-4cec-8733-80fcb04eec7a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:44 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 1073741824" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:44 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:44 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 Apr 15 00:23:44 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:44 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:44 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-0d8b917d-42db-4a1e-96e4-db237f9bfab2-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-0d8b917d-42db-4a1e-96e4-db237f9bfab2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:45 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.706s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1825114691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82622b1e-16d2-4de4-9535-f228da3f431f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume 82622b1e-16d2-4de4-9535-f228da3f431f {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:45 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97151e3-4f63-48cc-9631-48cbca3c2133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1179705b-981e-44ea-a2b1-47aee418e4a8', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:45 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:45 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f 1073741824 Apr 15 00:23:45 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08cd46a-65fa-4856-bfbd-b2992d9c50e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.554s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:45 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-1179705b-981e-44ea-a2b1-47aee418e4a8 (1179705b-981e-44ea-a2b1-47aee418e4a8): created successfully Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08cd46a-65fa-4856-bfbd-b2992d9c50e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:45 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:45 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (722e2b39-b81d-487d-ab0a-aed2773d277d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:45 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5bc00406-ac07-481f-a6b8-c3bf2690ecb3 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" acquired by "delete_volume" :: waited 0.024s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[103b1c24-6f60-41f2-8b6d-8f7159e4a70c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 Apr 15 00:23:45 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f 1073741824" returned: 0 in 0.521s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:45 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.478s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7 Apr 15 00:23:45 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f Apr 15 00:23:45 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:45 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2" returned: 0 in 0.482s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:45 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:45 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2 Apr 15 00:23:45 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:46 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97.53d13eaa-7de8-4c08-aaa3-85c469abeac7" returned: 0 in 0.416s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:46 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-53d13eaa-7de8-4c08-aaa3-85c469abeac7" released by "_delete_snapshot" :: held 1.996s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f" returned: 0 in 0.412s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.454s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238962442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c8122a9-a9df-4559-806a-a2a28bd6b38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume 3c8122a9-a9df-4559-806a-a2a28bd6b38c {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:46 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:46 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" released by "delete_snapshot" :: held 2.034s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-0d8b917d-42db-4a1e-96e4-db237f9bfab2" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:46 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c 1073741824 Apr 15 00:23:46 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c18ab9b-ab57-4146-ae7d-b6aee2bd8a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82622b1e-16d2-4de4-9535-f228da3f431f', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eeb1cfb-3ff2-48d8-97b1-f3e3c5801afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-quobyte-0d8b917d-42db-4a1e-96e4-db237f9bfab2" released by "delete_volume" :: held 0.949s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:46 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-82622b1e-16d2-4de4-9535-f228da3f431f (82622b1e-16d2-4de4-9535-f228da3f431f): created successfully Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eeb1cfb-3ff2-48d8-97b1-f3e3c5801afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (01532549-c836-42fb-b992-fef473c56654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d70a7dc4-699f-4c69-a89a-339e5cbffa59 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Created reservations ['0b6fbc6c-0663-4f5d-8629-f931006234b9', 'b74937dc-e9f8-4ba6-9ced-a67702136c9d', '4393a184-ff8c-49a9-9593-1d92424936bd', '85bc0bf7-327e-471b-a7b5-229ac8f4371b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Created reservations ['7883304f-1dd3-46e8-9bd6-dcc16023fff7', '3ee4ca74-5301-44cc-801d-e1dbce3b71bf', 'd5c497f7-eafe-4376-a9e5-57711fc2c20e', 'f729a3b0-f82d-483b-8152-205bebd0fcc7'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Delete snapshot completed successfully. Apr 15 00:23:46 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:46 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-7cf06072-4d73-4fff-b37e-fddaefb21094 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-53d13eaa-7de8-4c08-aaa3-85c469abeac7-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:46 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c 1073741824" returned: 0 in 0.519s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:46 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c Apr 15 00:23:46 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:46 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.431s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:46 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Deleted volume successfully. Apr 15 00:23:46 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-556bcff3-406d-418c-b88c-debbfa916bf4 tempest-CreateVolumesFromSnapshotTest-18303158 None] Lock "cinder-0d8b917d-42db-4a1e-96e4-db237f9bfab2-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:47 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c" returned: 0 in 0.404s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.181s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527839188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d607f77b-900d-4696-80b2-81f0f656f6c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29dc225974554f33a23bb540acd91df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:39Z,use_quota=True,user_id='59b41389609d4e5d991dd31df8f7292d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Creating volume d607f77b-900d-4696-80b2-81f0f656f6c9 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:47 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ac0f9f4-41e0-47d4-9e3d-fa8ba59b7083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:47 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 1073741824 Apr 15 00:23:47 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc9ece-95c6-499b-8701-5731303e3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:47 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c (3c8122a9-a9df-4559-806a-a2a28bd6b38c): created successfully Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3cc9ece-95c6-499b-8701-5731303e3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (e2026b5a-8ece-4924-8747-8b4fd0e00a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:47 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8d3462c2-0c08-4179-b3ab-990952c1e4f1 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a8bb96-0d44-4261-94d0-082c9822da22]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:47 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:47 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:47 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 1073741824" returned: 0 in 0.591s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:47 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:47 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 Apr 15 00:23:47 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:48 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.549s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:48 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97 Apr 15 00:23:48 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:48 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9" returned: 0 in 0.474s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.901s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:48 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Cloning volume ad845faa-a8bc-497f-b477-e436eb286f52 to volume e703e34d-f1db-40fa-828f-b61626ef497b Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f841a7-870c-4586-9c5a-27124bfcacf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d607f77b-900d-4696-80b2-81f0f656f6c9', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33611b17-f893-4ba8-85bc-2ed2e32f5b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:48 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Volume volume-d607f77b-900d-4696-80b2-81f0f656f6c9 (d607f77b-900d-4696-80b2-81f0f656f6c9): created successfully Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33611b17-f893-4ba8-85bc-2ed2e32f5b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Flow 'volume_create_manager' (c88fd8e1-949d-40de-a592-96cc0597b63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Creating offline snapshot da9e5951-7466-43c2-9689-4ac8701d7b97 of volume ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:23:48 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c7215344-1729-4097-beac-cd655406d68f tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created volume successfully. Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d71d2f-48a2-4ec5-9297-69b0e8489554]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:48 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:48 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:48 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97" released by "delete_volume" :: held 1.107s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Created reservations ['e0ba88cc-4da5-4215-b245-cf278d6167f1', '3f159983-fdf9-431e-a981-041f365d8ae7', 'bf4b06bf-ca09-498a-bffe-98d4b25f6ab3', 'db90e85f-100a-4120-b154-93ad4b3991b8'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:48 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:48 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-d607f77b-900d-4696-80b2-81f0f656f6c9-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-d607f77b-900d-4696-80b2-81f0f656f6c9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-d607f77b-900d-4696-80b2-81f0f656f6c9" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-d607f77b-900d-4696-80b2-81f0f656f6c9" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230beea-0059-4dfe-9a71-2a84edf7501f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:48 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:48 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 Apr 15 00:23:48 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:49 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.616s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:49 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 1G Apr 15 00:23:49 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:49 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.480s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:49 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Deleted volume successfully. Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-8828d308-95f5-43df-9fe5-32a82ca38685 tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-c60a9fa2-77d2-4477-a9cb-7e8cfa9e3a97-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:49 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9" returned: 0 in 0.574s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:23:49 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9 Apr 15 00:23:49 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Flow 'volume_create_manager' (98f50a80-52c4-4423-9a29-5e36d62c1e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664e5237-a6c1-434b-a81c-e817c401ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664e5237-a6c1-434b-a81c-e817c401ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72def4a3-b1b6-4b10-869c-f54d072d8a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a19c2dcf3c424f9f76a051f138c5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:49Z,use_quota=True,user_id='28f349ba1ccd4b93b9d74fe51b66e652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bc3f59-571c-4472-9086-85aab8a4d9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bc3f59-571c-4472-9086-85aab8a4d9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145829f-83fe-447d-957e-6534155104ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7145829f-83fe-447d-957e-6534155104ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72def4a3-b1b6-4b10-869c-f54d072d8a5b', 'volume_name': 'volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e867d-038c-4128-81b9-d37814dd6057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e867d-038c-4128-81b9-d37814dd6057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40570e3d-b849-4caf-bc9e-83e61fda8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:49 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Volume 72def4a3-b1b6-4b10-869c-f54d072d8a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b', 'volume_size': 1} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:49 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 1G" returned: 0 in 0.500s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad845faa-a8bc-497f-b477-e436eb286f52 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:49 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad845faa-a8bc-497f-b477-e436eb286f52 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:49 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-f643eca3-0be6-43a0-9400-2d5fb0fe2a73-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-f643eca3-0be6-43a0-9400-2d5fb0fe2a73-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ecfc6-6776-4e16-aa1f-8f37589f0ef2]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:49 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 Apr 15 00:23:49 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:49 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-d607f77b-900d-4696-80b2-81f0f656f6c9" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-d607f77b-900d-4696-80b2-81f0f656f6c9" released by "delete_volume" :: held 1.055s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['ee624fb8-fb3d-4b04-836d-68936976f83b', '392493fe-25d2-4238-b7d0-6da746151980', '1ea10ebd-015c-458b-85fc-573b17bad0cc', 'be782f7b-8c84-4a25-afcd-fa3078d89611'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:49 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:49 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:49 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:50 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad845faa-a8bc-497f-b477-e436eb286f52 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.499s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 is being set with open permissions: ugo+rw Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:50 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:50 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:50 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" returned: 0 in 0.513s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:50 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73 Apr 15 00:23:50 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:50 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.447s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:50 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-39e683ff-2d61-4cca-90fa-987b950b880b tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-d607f77b-900d-4696-80b2-81f0f656f6c9-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:50 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.426s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:50 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info Apr 15 00:23:50 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:50 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" returned: 0 in 0.406s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-quobyte-f643eca3-0be6-43a0-9400-2d5fb0fe2a73" released by "delete_volume" :: held 0.941s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Created reservations ['6455dd47-a849-42b1-ae9a-d2106d1fb80e', 'bd78d43c-ea07-4347-90a0-d6f41019672e', '53bb352f-631c-4f6d-a499-a00e938c7b9e', 'ddb3c79e-805c-4f5e-9e39-f5e5122f2787'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:50 devstack sudo[91213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:50 devstack sudo[91213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-3c8122a9-a9df-4559-806a-a2a28bd6b38c-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-3c8122a9-a9df-4559-806a-a2a28bd6b38c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:50 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info" returned: 0 in 0.451s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:50 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info is being set with open permissions: ugo+rw Apr 15 00:23:50 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-3c8122a9-a9df-4559-806a-a2a28bd6b38c" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:51 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info Apr 15 00:23:51 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-3c8122a9-a9df-4559-806a-a2a28bd6b38c" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[257e56ff-314e-4dc2-af5e-9b855ca2bdda]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:51 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c Apr 15 00:23:51 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:51 devstack sudo[91213]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.457s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:51 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Deleted volume successfully. Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a96fb11e-1a5d-4dc1-ae9f-3f4de0c7184b tempest-SnapshotDependencyTests-1002930710 None] Lock "cinder-f643eca3-0be6-43a0-9400-2d5fb0fe2a73-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:51 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.info" returned: 0 in 0.451s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" by "_copy_volume_from_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] snapshot: da9e5951-7466-43c2-9689-4ac8701d7b97, volume: e703e34d-f1db-40fa-828f-b61626ef497b, {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be763e2-f6d4-4611-a76a-19ab69dab4b8]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:51 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:51 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:51 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c" returned: 0 in 0.577s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:51 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c Apr 15 00:23:51 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:51 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.514s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad845faa-a8bc-497f-b477-e436eb286f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Creating direct copy from snapshot {{(pid=83219) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9fb62d-5b6b-4545-a38d-59683f7b4a78]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:51 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:52 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:52 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:52 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-3c8122a9-a9df-4559-806a-a2a28bd6b38c" returned: 0 in 0.468s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-3c8122a9-a9df-4559-806a-a2a28bd6b38c" released by "delete_volume" :: held 1.070s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['7538e9bd-1000-452e-b130-cbf8b95d8423', '59709d8d-c201-4193-adb8-026601854b30', 'afe38dc0-7ded-4b01-8563-dce7c5310d04', '7fa4f36a-856a-40ca-8747-7bca58b10771'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:52 devstack sudo[91236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:52 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:52 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.553s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.utils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Path /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b not found in is_blk_device check {{(pid=83219) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:52 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b Apr 15 00:23:52 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:52 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.440s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:52 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:23:52 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-a2449a6f-7ab0-424f-8612-b1305856bfd5 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-3c8122a9-a9df-4559-806a-a2a28bd6b38c-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-82622b1e-16d2-4de4-9535-f228da3f431f-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-82622b1e-16d2-4de4-9535-f228da3f431f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-82622b1e-16d2-4de4-9535-f228da3f431f" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-82622b1e-16d2-4de4-9535-f228da3f431f" acquired by "delete_volume" :: waited 0.019s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16674a-61d2-4a85-a609-345fd55285d7]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:53 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:53 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f Apr 15 00:23:53 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:54 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b" returned: 0 in 2.303s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:54 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e2542c-2b48-4999-80c8-ac0fedc011e4]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:54 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f" returned: 0 in 1.305s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:54 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:54 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:54 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:54 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f Apr 15 00:23:54 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:55 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-82622b1e-16d2-4de4-9535-f228da3f431f" returned: 0 in 0.411s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-82622b1e-16d2-4de4-9535-f228da3f431f" released by "delete_volume" :: held 1.759s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['6509c251-2f00-4ea2-9094-41954721628e', 'd776be0a-1af2-4d23-9e7c-a2fa2cf3814b', '3701bcc3-aa18-498d-ad6c-9658925d423c', 'a9063d1c-ad12-46ab-a692-463fd58e6fbd'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:55 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:55 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:55 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.646s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.image.image_utils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Image conversion details: src /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b {{(pid=83219) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 00:23:55 devstack cinder-volume[83219]: INFO cinder.image.image_utils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Converted 1024.00 MB image at 444.49 MB/s Apr 15 00:23:55 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b is being set with open permissions: ugo+rw Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:55 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b Apr 15 00:23:55 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-1179705b-981e-44ea-a2b1-47aee418e4a8-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-1179705b-981e-44ea-a2b1-47aee418e4a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-1179705b-981e-44ea-a2b1-47aee418e4a8" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-1179705b-981e-44ea-a2b1-47aee418e4a8" acquired by "delete_volume" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8671613-72b3-45b8-844e-7a317e875198]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:55 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:55 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:23:55 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4a1f3b2b-32ec-443d-b213-aa578ad8ed26 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-82622b1e-16d2-4de4-9535-f228da3f431f-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:55 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 Apr 15 00:23:55 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:56 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b" returned: 0 in 0.505s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" released by "_copy_volume_from_snapshot" :: held 4.565s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-da9e5951-7466-43c2-9689-4ac8701d7b97" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-da9e5951-7466-43c2-9689-4ac8701d7b97" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Deleting offline snapshot da9e5951-7466-43c2-9689-4ac8701d7b97 of volume ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] snapshot_file for this snap is: volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[734d64a6-69d4-4285-8695-fd633d26c583]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:56 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:56 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:56 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8" returned: 0 in 0.554s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:56 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8 Apr 15 00:23:56 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:56 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.521s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad845faa-a8bc-497f-b477-e436eb286f52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b61fe9-0c98-441e-ac6d-c036eee76933]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:56 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:56 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:56 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-1179705b-981e-44ea-a2b1-47aee418e4a8" returned: 0 in 0.536s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-1179705b-981e-44ea-a2b1-47aee418e4a8" released by "delete_volume" :: held 1.112s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:56 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['de5e15c8-10ea-48c8-b781-c7620033ec0e', '29d30f32-49ec-4eb7-9ce0-9f9ef93ebdbf', 'd7430aab-0062-4d19-8d81-e2b1b60cc404', '8d74c997-45cd-44e3-be43-d62e713f2c36'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:57 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:57 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:57 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.574s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:57 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:57 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:57 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.421s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:57 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-b2f02f72-2d84-4372-a324-623fad566463 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-1179705b-981e-44ea-a2b1-47aee418e4a8-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:57 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.495s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:57 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:57 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97 Apr 15 00:23:57 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-249b13fb-24a8-4dc0-8c11-b87bf3814c78-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-249b13fb-24a8-4dc0-8c11-b87bf3814c78-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-249b13fb-24a8-4dc0-8c11-b87bf3814c78" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-249b13fb-24a8-4dc0-8c11-b87bf3814c78" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[608ea668-15aa-4aa5-a050-dc353e174f8f]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:58 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52.da9e5951-7466-43c2-9689-4ac8701d7b97" returned: 0 in 0.487s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-da9e5951-7466-43c2-9689-4ac8701d7b97" released by "_delete_snapshot" :: held 2.134s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.791s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.697s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72def4a3-b1b6-4b10-869c-f54d072d8a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a19c2dcf3c424f9f76a051f138c5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:23:49Z,use_quota=True,user_id='28f349ba1ccd4b93b9d74fe51b66e652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Creating volume 72def4a3-b1b6-4b10-869c-f54d072d8a5b {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:23:58 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:58 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 Apr 15 00:23:58 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947cd937-1a7a-431b-bb71-9d265a1a703e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e703e34d-f1db-40fa-828f-b61626ef497b', 'volume_size': 1, 'source_volid': 'ad845faa-a8bc-497f-b477-e436eb286f52', 'source_volstatus': 'available'}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:58 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b 1073741824 Apr 15 00:23:58 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a10f71-898b-4437-8cae-5f20ace1e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:58 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Volume volume-e703e34d-f1db-40fa-828f-b61626ef497b (e703e34d-f1db-40fa-828f-b61626ef497b): created successfully Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a10f71-898b-4437-8cae-5f20ace1e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Flow 'volume_create_manager' (6d0ac601-2529-47a5-9cb2-4dc1b1a7abc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:58 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-4426d169-da4d-4acf-9104-94ca73d4b564 tempest-VolumeDependencyTests-1166042715 None] Created volume successfully. Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-ad845faa-a8bc-497f-b477-e436eb286f52-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-ad845faa-a8bc-497f-b477-e436eb286f52-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-ad845faa-a8bc-497f-b477-e436eb286f52" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-ad845faa-a8bc-497f-b477-e436eb286f52" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce2f91-3eb5-4c73-81f7-9271802ba66c]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:58 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78" returned: 0 in 0.626s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:58 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78 Apr 15 00:23:58 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:58 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b 1073741824" returned: 0 in 0.599s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:58 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:58 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:58 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:58 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b Apr 15 00:23:58 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:59 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-249b13fb-24a8-4dc0-8c11-b87bf3814c78" returned: 0 in 0.461s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-249b13fb-24a8-4dc0-8c11-b87bf3814c78" released by "delete_volume" :: held 1.112s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:59 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b" returned: 0 in 0.442s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40570e3d-b849-4caf-bc9e-83e61fda8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1bac5f-0f36-4696-865d-a577143eebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:23:59 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Volume volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b (72def4a3-b1b6-4b10-869c-f54d072d8a5b): created successfully Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1bac5f-0f36-4696-865d-a577143eebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Flow 'volume_create_manager' (98f50a80-52c4-4423-9a29-5e36d62c1e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['bf25c158-47ee-40a5-99d9-b98a1d0a94b5', 'f7d16fe1-2bbd-4a4d-b1a3-288ec71b5b17', '994c6bc8-36eb-4eeb-a8a8-aa7136f3c82e', 'db91b6d6-abe5-4d20-989e-43e0313c27d4'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:59 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b2432808-0608-4526-b7fc-f15bbc25c420 tempest-CinderUnicodeTest-173507057 None] Created volume successfully. Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.571s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:59 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52 Apr 15 00:23:59 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:59 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:59 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:23:59 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-ad845faa-a8bc-497f-b477-e436eb286f52" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-ad845faa-a8bc-497f-b477-e436eb286f52" released by "delete_volume" :: held 1.033s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:59 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.420s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:23:59 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Created reservations ['6ce63da1-52ff-431b-bbcb-006d5da91a81', '4de779e7-3340-4b66-9271-9787cc91e7ed', '3c50807b-e32e-4aa8-b44c-ab7e5f1a9886', '893ab6f3-6fc2-4ff6-b655-a19d6aef988b'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-5ed4ebe8-8c4f-4a0b-a6cc-d8b5eb7d6a67 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-249b13fb-24a8-4dc0-8c11-b87bf3814c78-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:23:59 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:23:59 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:23:59 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-edeff53d-9982-44f3-bb2d-f57f99cd74d5-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-edeff53d-9982-44f3-bb2d-f57f99cd74d5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "cinder-quobyte-edeff53d-9982-44f3-bb2d-f57f99cd74d5" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-edeff53d-9982-44f3-bb2d-f57f99cd74d5" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:00 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.439s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b14421-5a09-4c17-9d03-f499c755ee1a]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:00 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Deleted volume successfully. Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-508e5649-0475-4638-80cf-b36ca7836566 tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-ad845faa-a8bc-497f-b477-e436eb286f52-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:00 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 Apr 15 00:24:00 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83219) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Flow 'volume_create_manager' (b4d6c10e-a317-46af-b65e-fdc87ff64aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea105c96-7253-4c2f-b9ad-d48333c073a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea105c96-7253-4c2f-b9ad-d48333c073a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:24:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-665415614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e951ec-e365-408a-85b4-e29f320a3402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a19c2dcf3c424f9f76a051f138c5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:24:00Z,use_quota=True,user_id='28f349ba1ccd4b93b9d74fe51b66e652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777b7b6c-7e11-4fb2-990b-bf1d46455af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777b7b6c-7e11-4fb2-990b-bf1d46455af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca833bd-0a3b-47db-9661-3e5d2fb526e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca833bd-0a3b-47db-9661-3e5d2fb526e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e951ec-e365-408a-85b4-e29f320a3402', 'volume_name': 'volume-e6e951ec-e365-408a-85b4-e29f320a3402', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316e4969-beaf-4730-9745-613d810087ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316e4969-beaf-4730-9745-613d810087ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6012a4-267c-414c-b386-91fdfc5068f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:00 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Volume e6e951ec-e365-408a-85b4-e29f320a3402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e951ec-e365-408a-85b4-e29f320a3402', 'volume_size': 1} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-14T22:24:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-665415614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e951ec-e365-408a-85b4-e29f320a3402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a19c2dcf3c424f9f76a051f138c5b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-14T22:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-14T22:24:00Z,use_quota=True,user_id='28f349ba1ccd4b93b9d74fe51b66e652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db10a1ad-6dae-4f3b-84c5-e49e26272e08),volume_type_id=db10a1ad-6dae-4f3b-84c5-e49e26272e08)}" {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Creating volume e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Selected osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 as target Quobyte volume. {{(pid=83219) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 00:24:00 devstack cinder-volume[83219]: INFO cinder.volume.drivers.remotefs [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] casted to osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29 Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 1073741824 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:00 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 1073741824 Apr 15 00:24:00 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:00 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5" returned: 0 in 0.496s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:00 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5 Apr 15 00:24:00 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-e703e34d-f1db-40fa-828f-b61626ef497b-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-e703e34d-f1db-40fa-828f-b61626ef497b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" acquired by "delete_volume" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c0bbf-f4fb-4037-8ecf-75e4a8ceeb7e]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:00 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:00 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b Apr 15 00:24:00 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:01 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 1073741824" returned: 0 in 0.525s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:01 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 Apr 15 00:24:01 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:01 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-edeff53d-9982-44f3-bb2d-f57f99cd74d5" returned: 0 in 0.464s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-quobyte-edeff53d-9982-44f3-bb2d-f57f99cd74d5" released by "delete_volume" :: held 0.988s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Created reservations ['8b3d2924-f916-433f-a16b-bd9fb5d874a0', '9e86bf66-503d-4dad-ad5b-37024f36d7e3', 'e747b644-1d88-4cb8-9435-3de603c5387c', 'cb8a1a95-63fd-45b8-9de2-1e0275d56b8a'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:01 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:24:01 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:01 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b" returned: 0 in 0.522s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:01 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b Apr 15 00:24:01 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:01 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'} {{(pid=83219) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6012a4-267c-414c-b386-91fdfc5068f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e951ec-e365-408a-85b4-e29f320a3402', 'volume_size': 1}' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2931ad1-e707-4f5e-a716-802ea2765243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 00:24:01 devstack cinder-volume[83219]: INFO cinder.volume.flows.manager.create_volume [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Volume volume-e6e951ec-e365-408a-85b4-e29f320a3402 (e6e951ec-e365-408a-85b4-e29f320a3402): created successfully Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2931ad1-e707-4f5e-a716-802ea2765243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83219) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Flow 'volume_create_manager' (b4d6c10e-a317-46af-b65e-fdc87ff64aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83219) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 00:24:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-b0bd4ce3-0228-411b-baf5-fbce2376a6b5 tempest-CinderUnicodeTest-173507057 None] Created volume successfully. Apr 15 00:24:01 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.421s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:01 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Deleted volume successfully. Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-af3834aa-8ef7-4fde-affb-4e13cefac111 tempest-CreateVolumesFromSourceVolumeTest-1324312982 None] Lock "cinder-edeff53d-9982-44f3-bb2d-f57f99cd74d5-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:01 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e703e34d-f1db-40fa-828f-b61626ef497b" returned: 0 in 0.417s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-e703e34d-f1db-40fa-828f-b61626ef497b" released by "delete_volume" :: held 0.960s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Created reservations ['9b64752c-b664-4745-bd4e-1a30a92366f9', '92ede9c4-7089-48e1-8907-ec15d4ef3122', '7bebe39b-2a00-4dbd-842a-1b8ac2219411', '3dcab9c9-a011-41e4-b96b-fd63d30113dc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:01 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:24:01 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:01 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" acquired by "delete_volume" :: waited 0.008s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fd68d1-a24e-4fa2-8785-e39726646771]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:02 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 Apr 15 00:24:02 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:02 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.432s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:02 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Deleted volume successfully. Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-fff16774-39bf-4b96-a604-a071dfe05f5d tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-e703e34d-f1db-40fa-828f-b61626ef497b-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:02 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" returned: 0 in 0.560s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:02 devstack sudo[91374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482 Apr 15 00:24:02 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Creating offline snapshot 150954da-248e-4ae9-a5da-025eb16a58d0 of volume e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed98e9-fc8e-4c66-b25f-db8ce869ffef]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:02 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:02 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 Apr 15 00:24:02 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:03 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" returned: 0 in 0.568s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-quobyte-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482" released by "delete_volume" :: held 1.151s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Created reservations ['4d9b2c17-31f0-457b-903a-6ae070967154', 'ca4e32db-c3e5-4a4e-91fd-42caef6c3979', '5cd869a3-8f2b-4044-bfee-44b71295d6e9', '0d98165c-3dda-4d5c-93c5-947ae4f05bdc'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:03 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402" returned: 0 in 0.563s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 1G {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:03 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:24:03 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:03 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 1G Apr 15 00:24:03 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:03 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.444s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:03 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Deleted volume successfully. Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-04c0c25f-b214-44af-bf20-0645c1abfacb tempest-VolumeDependencyTests-1166042715 None] Lock "cinder-9d3a2aae-3c7d-4f4f-b2c8-09baddcb8482-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:03 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 1G" returned: 0 in 0.475s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:03 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e951ec-e365-408a-85b4-e29f320a3402 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:03 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e951ec-e365-408a-85b4-e29f320a3402 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 Apr 15 00:24:03 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:04 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6e951ec-e365-408a-85b4-e29f320a3402 -F qcow2 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0" returned: 0 in 0.424s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:04 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 is being set with open permissions: ugo+rw Apr 15 00:24:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:04 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 Apr 15 00:24:04 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:04 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0" returned: 0 in 0.465s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:04 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:04 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info Apr 15 00:24:04 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:05 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info" returned: 0 in 0.466s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:05 devstack cinder-volume[83219]: WARNING cinder.volume.drivers.remotefs [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info is being set with open permissions: ugo+rw Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:05 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info Apr 15 00:24:05 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:05 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.info" returned: 0 in 0.396s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.850s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:05 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-d734d021-bfb5-42f0-aa5e-4ce46330ad6c tempest-CinderUnicodeTest-173507057 None] Create snapshot completed successfully Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-150954da-248e-4ae9-a5da-025eb16a58d0-delete_snapshot" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-150954da-248e-4ae9-a5da-025eb16a58d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" by "delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-quobyte-150954da-248e-4ae9-a5da-025eb16a58d0" by "_delete_snapshot" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-150954da-248e-4ae9-a5da-025eb16a58d0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Deleting offline snapshot 150954da-248e-4ae9-a5da-025eb16a58d0 of volume e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] snapshot_file for this snap is: volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fcfc3d-c229-4b41-b3c6-453708faaa58]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:05 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:05 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 Apr 15 00:24:05 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:06 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.remotefs [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6e951ec-e365-408a-85b4-e29f320a3402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83219) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4bbed8-770c-4af4-8034-3975fb231fcc]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:06 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 Apr 15 00:24:06 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:06 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:06 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:06 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 Apr 15 00:24:06 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:07 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0" returned: 0 in 0.443s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:07 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0 Apr 15 00:24:07 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:07 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402.150954da-248e-4ae9-a5da-025eb16a58d0" returned: 0 in 0.412s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=209,cinder:UPDATE=311,cinder:INSERT=76,cinder:DELETE=25 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:UPDATE=252,cinder:SELECT=193,cinder:DELETE=27,cinder:INSERT=57 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-150954da-248e-4ae9-a5da-025eb16a58d0" released by "_delete_snapshot" :: held 1.847s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" released by "delete_snapshot" :: held 1.858s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Created reservations ['6f129cde-10e3-4496-87f6-b53b9f1b565b', '8df4abce-9a32-4365-937a-e20311b00578', 'e32974e2-35c6-481d-9125-cd371090e09b', 'd19ac2f0-a129-456f-af10-29a59becb514'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:07 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Delete snapshot completed successfully. Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-1786c092-08e3-4a3d-9774-29d719acd716 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-150954da-248e-4ae9-a5da-025eb16a58d0-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-e6e951ec-e365-408a-85b4-e29f320a3402-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:07 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-e6e951ec-e365-408a-85b4-e29f320a3402-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" acquired by "delete_volume" :: waited 0.012s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12626da-0a37-4633-89f0-cf65a0c5420b]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:08 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 Apr 15 00:24:08 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:08 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402" returned: 0 in 0.463s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:08 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402 Apr 15 00:24:08 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:08 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-e6e951ec-e365-408a-85b4-e29f320a3402" returned: 0 in 0.400s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-e6e951ec-e365-408a-85b4-e29f320a3402" released by "delete_volume" :: held 0.894s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Created reservations ['abf9a2d1-b70b-4bbb-9cfd-c73e48b606ec', '8bef9128-6c4e-409f-9066-22d845f4a03b', 'ed1e196b-49da-40dd-a47a-3480650f5149', 'e6684616-e2a9-4851-a2da-53205b7a6f15'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:08 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:09 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:24:09 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-72def4a3-b1b6-4b10-869c-f54d072d8a5b-delete_volume" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-72def4a3-b1b6-4b10-869c-f54d072d8a5b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "cinder-quobyte-72def4a3-b1b6-4b10-869c-f54d072d8a5b" by "delete_volume" {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-72def4a3-b1b6-4b10-869c-f54d072d8a5b" acquired by "delete_volume" :: waited 0.010s {{(pid=83219) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e066d8-7995-49aa-b69e-a5bdd15cf590]: (4, 'qcow2') {{(pid=84116) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:09 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b Apr 15 00:24:09 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:09 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.418s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:09 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Deleted volume successfully. Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-c54cdaa5-0968-4678-b0d4-4a886d9d25f2 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-e6e951ec-e365-408a-85b4-e29f320a3402-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:09 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b" returned: 0 in 0.473s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:09 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:09 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b Apr 15 00:24:09 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:10 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259/volume-72def4a3-b1b6-4b10-869c-f54d072d8a5b" returned: 0 in 0.400s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-quobyte-72def4a3-b1b6-4b10-869c-f54d072d8a5b" released by "delete_volume" :: held 0.898s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.quota [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Created reservations ['093eeb4d-fbd0-4cee-9ae0-e4c832f92449', '78948f87-f583-49e8-991d-aa07a71541ae', '119d1817-0ca7-400c-8838-ee6de034c85e', '9edfa530-50e8-4196-8bb3-e9e7075b6135'] {{(pid=83219) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29': None} {{(pid=83219) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.volume.drivers.quobyte [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ed2d2dc-6102-44b5-9d4f-0641a1610e29'] {{(pid=83219) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.lockutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83219) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 00:24:10 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259 Apr 15 00:24:10 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 00:24:10 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG oslo_concurrency.processutils [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e5707122fe2b342b245775a984708259" returned: 0 in 0.469s {{(pid=83219) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.manager [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Notifying Schedulers of capabilities ... {{(pid=83219) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 00:24:10 devstack cinder-volume[83219]: INFO cinder.volume.manager [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Deleted volume successfully. Apr 15 00:24:10 devstack cinder-volume[83219]: DEBUG cinder.coordination [None req-f29e6cfc-0bff-4932-8c6c-d260bacda649 tempest-CinderUnicodeTest-173507057 None] Lock "cinder-72def4a3-b1b6-4b10-869c-f54d072d8a5b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=83219) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 00:24:20 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=18 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 00:24:20 devstack cinder-volume[83219]: DEBUG dbcounter [-] [83219] Writing DB stats cinder:SELECT=13,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=83219) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}